[ 589.748955] env[61538]: INFO neutron.common.config [-] Logging enabled! [ 589.749261] env[61538]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev19 [ 589.749449] env[61538]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=61538) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 589.749749] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 589.749851] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 589.750713] env[61538]: WARNING oslo_policy.policy [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 589.750937] env[61538]: WARNING oslo_policy.policy [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 589.752485] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] VMware NSXv3 Agent initialized successfully. [ 589.752845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] Acquiring lock "singleton_lock" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.752983] env[61538]: DEBUG oslo_concurrency.lockutils [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] Acquired lock "singleton_lock" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.753208] env[61538]: DEBUG oslo_concurrency.lockutils [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] Releasing lock "singleton_lock" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.753502] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] Full set of CONF: {{(pid=61538) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 589.753722] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ******************************************************************************** {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 589.753887] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] Configuration options gathered from: {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 589.754133] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 589.754308] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 589.754516] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ================================================================================ {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 589.754609] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] agent_down_time = 75 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.754739] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] allow_automatic_dhcp_failover = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.754892] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] allow_bulk = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.755049] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] api_extensions_path = {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.755201] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] api_paste_config = api-paste.ini {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.755350] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] auth_strategy = keystone {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.755467] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] backdoor_port = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.755576] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] backdoor_socket = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.755720] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] backlog = 4096 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.755867] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] base_mac = fa:16:3e:00:00:00 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.756044] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] bind_host = 0.0.0.0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.756223] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] bind_port = 9696 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.756376] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] client_socket_timeout = 900 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.756526] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] config_dir = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.756644] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.756790] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] config_source = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.756942] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] control_exchange = neutron {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.757115] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] core_plugin = ml2 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.757252] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] debug = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.757397] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] default_availability_zones = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.757608] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.757756] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] dhcp_agent_notification = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.757901] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] dhcp_agents_per_network = 1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.758059] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] dhcp_lease_duration = 86400 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.758211] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] dhcp_load_type = networks {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.758358] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] dns_domain = openstacklocal {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.758502] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.758644] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] enable_default_route_bfd = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.758799] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] enable_default_route_ecmp = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.758923] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] enable_dvr = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.759073] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] enable_new_agents = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.759216] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] enable_services_on_agents_with_admin_state_down = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.759354] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] enable_signals = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.759492] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] enable_traditional_dhcp = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.759626] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] external_dns_driver = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.759763] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] filter_validation = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.759913] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] global_physnet_mtu = 8950 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.760206] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] graceful_shutdown_timeout = 60 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.760241] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] host = cpu-1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.760393] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] host_dvr_for_dhcp = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.760564] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] http_retries = 3 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.760680] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] instance_format = [instance: %(uuid)s] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.760822] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.760967] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ipam_driver = internal {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.761129] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ipv6_pd_enabled = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.761272] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] l3_ha = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.761416] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.761558] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] l3_ha_network_physical_name = {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.761699] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] l3_ha_network_type = {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.761869] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] log_color = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.762023] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] log_config_append = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.762149] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.762288] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] log_dir = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.762431] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] log_file = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.762531] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] log_options = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.762674] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] log_rotate_interval = 1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.762821] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] log_rotate_interval_type = days {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.762966] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] log_rotation_type = none {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.763150] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.763212] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.763393] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.763508] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.763638] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.763794] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] max_dns_nameservers = 5 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.763966] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] max_header_line = 16384 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.764219] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] max_l3_agents_per_router = 3 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.764523] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] max_logfile_count = 30 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.764750] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] max_logfile_size_mb = 200 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.764988] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] max_subnet_host_routes = 20 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.765241] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] my_ip = 10.180.1.21 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.765456] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] my_ipv6 = ::1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.765628] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] network_auto_schedule = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.765812] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] network_link_prefix = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.765921] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.766089] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] notify_nova_on_port_data_changes = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.766275] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] notify_nova_on_port_status_changes = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.766430] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] pagination_max_limit = -1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.766575] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] publish_errors = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.766718] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] rate_limit_burst = 0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.766867] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] rate_limit_except_level = CRITICAL {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.767028] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] rate_limit_interval = 0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.767166] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] retry_until_window = 30 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.767308] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] router_distributed = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.767452] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] rpc_resources_processing_step = 20 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.767590] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] rpc_response_max_timeout = 600 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.767731] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] rpc_response_timeout = 60 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.767871] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] send_events_interval = 2 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.768044] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] service_plugins = ['router'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.768192] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] setproctitle = on {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.768334] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] shell_completion = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.768481] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] state_path = /opt/stack/data/neutron {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.768625] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] syslog_log_facility = LOG_USER {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.768766] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] tcp_keepidle = 600 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.768911] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] transport_url = **** {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.769065] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] use_journal = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.769206] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] use_json = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.769347] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] use_ssl = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.769484] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] use_stderr = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.769629] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] use_syslog = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.769768] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] vlan_qinq = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.769907] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] vlan_transparent = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.770061] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] watch_log_file = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.770204] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] wsgi_default_pool_size = 100 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.770344] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] wsgi_keep_alive = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.770492] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.770720] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] wsgi_server_debug = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 589.770780] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_concurrency.disable_process_locking = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.770936] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.771102] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.771248] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.771395] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.771542] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.771683] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.771839] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.connection_string = messaging:// {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.771989] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.enabled = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.772158] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.es_doc_type = notification {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.772301] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.es_scroll_size = 10000 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.772447] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.es_scroll_time = 2m {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.772589] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.filter_error_trace = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.772735] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.hmac_keys = **** {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.772881] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.sentinel_service_name = mymaster {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.773044] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.socket_timeout = 0.1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.773196] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.trace_requests = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.773333] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler.trace_sqlalchemy = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.773486] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler_jaeger.process_tags = {} {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.773627] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler_jaeger.service_name_prefix = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.773768] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] profiler_otlp.service_name_prefix = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.773955] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.enforce_new_defaults = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.774407] env[61538]: WARNING oslo_config.cfg [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 589.774523] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.enforce_scope = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.774704] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.policy_default_rule = default {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.774743] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.774873] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.775037] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.775185] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.775326] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.775467] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.775611] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.775761] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_policy.remote_timeout = 60.0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.775918] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.776086] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] agent.extensions = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.776266] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.776429] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] service_providers.service_provider = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.776588] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.default_quota = -1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.776740] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.776886] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.quota_floatingip = 50 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.777043] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.quota_network = 100 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.777190] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.quota_port = 500 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.777330] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.quota_rbac_policy = 10 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.777471] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.quota_router = 10 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.777613] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.quota_security_group = 10 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.777754] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.quota_security_group_rule = 100 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.777895] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.quota_subnet = 100 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.778080] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] QUOTAS.track_quota_usage = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.778249] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.778393] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep.group = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.778536] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep.helper_command = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.778683] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep.logger_name = oslo_privsep.daemon {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.778829] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep.thread_pool_size = 8 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.778969] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep.user = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.779135] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.779280] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_dhcp_release.group = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.779420] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_dhcp_release.helper_command = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.779564] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.779708] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.779847] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_dhcp_release.user = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.779998] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.780152] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_ovs_vsctl.group = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.780291] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_ovs_vsctl.helper_command = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.780435] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.780580] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.780733] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_ovs_vsctl.user = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.780889] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_namespace.capabilities = [21] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.780997] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_namespace.group = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.781151] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_namespace.helper_command = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.781295] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.781440] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_namespace.thread_pool_size = 8 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.781579] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_namespace.user = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.781731] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_conntrack.capabilities = [12] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.781889] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_conntrack.group = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.782053] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_conntrack.helper_command = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.782207] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.782353] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_conntrack.thread_pool_size = 8 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.782492] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_conntrack.user = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.782647] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_link.capabilities = [12, 21] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.782787] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_link.group = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.782925] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_link.helper_command = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.783079] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.783226] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_link.thread_pool_size = 8 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.783362] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] privsep_link.user = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.783524] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.783678] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.783827] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.continue_on_failed_promotions = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.784009] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.dscp = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.784183] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.dscp_inherit = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.784349] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.force_mp_to_policy = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.784489] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.locking_coordinator_url = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.784633] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.log_agent_heartbeats = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.784780] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.logging_expire = 1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.784992] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.785133] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.785295] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.polling_interval = 240 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.785444] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.785598] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.quitting_rpc_timeout = 120 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.785749] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.report_interval = 30.0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.785899] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.786062] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.786238] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.786399] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.sync_skew = 60 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.786547] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.synchronization_queue_size = 20 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.786698] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT.use_helper_for_ns_read = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.786851] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] SECURITYGROUP.enable_ipset = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.787014] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] SECURITYGROUP.enable_security_group = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.787172] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.787324] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.787477] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] experimental.ipv6_pd_enabled = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.787646] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ml2.extension_drivers = ['port_security'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.787792] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ml2.external_network_type = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.787953] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.788191] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ml2.overlay_ip_version = 4 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.788454] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ml2.path_mtu = 8950 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.788706] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ml2.physical_network_mtus = {} {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.788909] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ml2.tenant_network_types = ['vlan'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.789088] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.789249] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ml2.type_drivers = ['vlan'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.789405] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT_CLI.neutron_port_id = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.789550] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.789730] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.789920] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.790122] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.790287] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.790442] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.790596] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.790748] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.791035] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.791199] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_login_password = **** {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.791349] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_login_port = 443 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.791505] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_login_user = admin {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.791655] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.791811] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.791985] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.792180] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.792377] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.792505] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.792659] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.792809] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.792962] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.793165] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.793318] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.793465] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.793616] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.793825] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.794018] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] vsphere.vsphere_login_password = VMware1! {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.794181] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.794331] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.794489] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.auth_section = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.794645] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.auth_type = password {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.794795] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.794956] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.certfile = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.795119] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.collect_timing = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.795243] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.endpoint_type = public {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.795390] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.insecure = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.795529] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.keyfile = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.795678] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.region_name = RegionOne {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.795820] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.split_loggers = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.795967] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] nova.timeout = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.796141] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.auth_section = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.796316] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.auth_type = password {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.796468] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.796608] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.certfile = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.796753] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.collect_timing = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.796900] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.endpoint_type = public {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.797056] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.insecure = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.797197] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.keyfile = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.797333] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.region_name = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.797476] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.split_loggers = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.797612] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] placement.timeout = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.797759] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.auth_section = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.797900] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.auth_type = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.798048] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.cafile = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.798187] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.certfile = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.798329] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.collect_timing = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.798466] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.connect_retries = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.798614] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.connect_retry_delay = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.798761] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.enable_notifications = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.798899] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.endpoint_override = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.799050] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.insecure = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.799191] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.interface = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.799332] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.keyfile = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.799460] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.max_version = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.799594] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.min_version = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.799729] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.region_name = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.799863] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.retriable_status_codes = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.799998] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.service_name = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.800147] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.service_type = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.800296] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.split_loggers = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.800423] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.status_code_retries = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.800557] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.status_code_retry_delay = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.800692] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.timeout = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.800827] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.valid_interfaces = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.800962] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ironic.version = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.801172] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] cli_script.dry_run = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.801276] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.801408] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.801552] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.801694] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.801838] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.801980] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.802131] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.802275] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.802418] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.802563] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.802699] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.802849] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.803014] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.803162] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.803352] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.803450] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.803598] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.803742] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.803985] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.804077] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.804238] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.804370] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.804518] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.804728] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.804924] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.805102] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.805253] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.805399] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.805541] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.805686] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.805831] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.ssl = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.805981] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.806153] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.806287] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.806434] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.806577] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.ssl_version = {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.806725] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.806870] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_notifications.driver = [] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.807023] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_notifications.retry = -1 {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.807186] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.807328] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] oslo_messaging_notifications.transport_url = **** {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 589.807440] env[61538]: DEBUG oslo_service.backend.eventlet.service [None req-8f9d4c57-337c-4171-a966-4c1b8adb55cb None None] ******************************************************************************** {{(pid=61538) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 589.808468] env[61538]: DEBUG neutron.agent.securitygroups_rpc [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Init firewall settings (driver=nsxv3) {{(pid=61538) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 589.809849] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=61538) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 589.810117] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] RPC agent_id: nsxm-l-01a.corp.local [ 589.812395] env[61538]: DEBUG dogpile.cache.region [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.812522] env[61538]: DEBUG dogpile.lock [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.812616] env[61538]: DEBUG dogpile.lock [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.812710] env[61538]: DEBUG dogpile.lock [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.812803] env[61538]: DEBUG dogpile.cache.region [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.812894] env[61538]: DEBUG dogpile.lock [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.813031] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.853119] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Session token - acquiring [ 589.855071] env[61538]: DEBUG networking_nsxv3.common.locking [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.855301] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.855379] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.855816] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.867100] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.144582] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 590.170874] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.171072] env[61538]: DEBUG dogpile.cache.region [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Cache value generated in 0.358 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 590.171194] env[61538]: DEBUG dogpile.lock [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.171260] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Activating Policy API Provider. [ 590.171466] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Looking for the default Infrastructure Rules. [ 590.263788] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Looking for the Default Layer3 Logged Drop Section. [ 590.279045] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 590.279661] env[61538]: DEBUG networking_nsxv3.common.locking [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.279850] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquiring lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.279958] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.280261] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired external semaphore "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.280603] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.796651] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.298696] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.801196] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Inventory metadata is going to be refreshed. [ 591.801575] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 592.606638] env[61538]: DEBUG networking_nsxv3.common.locking [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.606915] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.606915] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.607271] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.620092] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 592.731580] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.732620] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 592.751471] env[61538]: DEBUG networking_nsxv3.common.locking [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.751684] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.751735] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.752114] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.752253] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.752435] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 592.752550] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 592.752624] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 592.773536] env[61538]: DEBUG networking_nsxv3.common.locking [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.773772] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.773819] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.774195] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.774371] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.774523] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 592.795057] env[61538]: DEBUG networking_nsxv3.common.locking [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.795287] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.795336] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.795623] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.795773] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.795919] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 592.814949] env[61538]: DEBUG networking_nsxv3.common.locking [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.815353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquiring lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.815353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.815538] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired external semaphore "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.815682] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Releasing lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.815840] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 592.815948] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 592.816067] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 592.835262] env[61538]: DEBUG networking_nsxv3.common.locking [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.835516] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquiring lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.835588] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.835820] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired external semaphore "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.835950] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Releasing lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.836121] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 592.836291] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 592.836413] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 592.857876] env[61538]: DEBUG networking_nsxv3.common.locking [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.858098] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.858098] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.858413] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.858560] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.858715] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 592.858822] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 592.858925] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Inventory metadata have been refreshed. [ 592.859038] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Dryrun:True. Metadata refresh completed. [ 592.859160] env[61538]: DEBUG oslo_concurrency.lockutils [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Releasing lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.860939] env[61538]: INFO neutron.agent.agent_extensions_manager [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Loaded agent extensions: [] [ 592.861659] env[61538]: DEBUG neutron_lib.callbacks.manager [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=61538) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 592.916160] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NSXv3 Agent Agent RPC Daemon Started! [ 592.916294] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NSXv3 Agent Agent loop - iteration:0 started [ 592.916396] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NSXv3 Agent Agent out of sync with plugin! [ 597.862031] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 597.862031] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 602.863435] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 602.863827] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 607.287736] env[61538]: INFO networking_nsxv3.common.synchronization [None req-9cef0e34-7c07-44dc-8029-7af8d646f473 demo admin] Enqueued Resource ID: 631dc1f1-d003-45e7-aec7-6583e51802d3 with Priority: HIGHEST for action security_group_rules [ 607.287974] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 631dc1f1-d003-45e7-aec7-6583e51802d3 with Priority: HIGHEST for action security_group_rules [ 607.288402] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-631dc1f1-d003-45e7-aec7-6583e51802d3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.288583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-631dc1f1-d003-45e7-aec7-6583e51802d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.288671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-631dc1f1-d003-45e7-aec7-6583e51802d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.288980] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-631dc1f1-d003-45e7-aec7-6583e51802d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.289075] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('631dc1f1-d003-45e7-aec7-6583e51802d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.815046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.815338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.815338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.815511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.815673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.815673] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 631dc1f1-d003-45e7-aec7-6583e51802d3 already deleted. [ 607.815799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-631dc1f1-d003-45e7-aec7-6583e51802d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.289458] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 612.289458] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 613.864539] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.864963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.864963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.865081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.865259] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.367805] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.870756] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.373759] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 615.373961] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 616.158494] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.158946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.158946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.158946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.171682] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 616.172546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.173208] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 616.191642] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.191845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.191885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.192141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.192278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.192379] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 616.192437] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 616.192495] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 616.211194] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.211495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.211495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.211620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.211780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.211948] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 616.230778] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.230982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.230982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.231203] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.231314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.231429] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 616.249483] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.249730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.249730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.249863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.249955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.250084] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 616.250157] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 616.250230] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 616.269877] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.270116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.270116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.270298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.270387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.270496] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 616.270567] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 616.270638] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 616.292318] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.292558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.292558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.292690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.292793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.292913] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 616.292978] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 616.293052] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 616.293113] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 616.293188] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 616.293247] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 616.293297] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 616.293583] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 616.293646] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 616.293705] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 616.311197] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.311351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.311399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.311571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.311677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.311783] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 616.332041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.332262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.332313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.332513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.332621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.374026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.291159] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 617.291578] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 622.293193] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 622.293563] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 627.297210] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 627.300138] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 632.298390] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 632.298725] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 636.926043] env[61538]: INFO networking_nsxv3.common.synchronization [None req-9582c68f-81ce-46e7-a67e-ef665d9b184c None None] Enqueued Resource ID: b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3 with Priority: HIGHEST for action port [ 636.926288] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3 with Priority: HIGHEST for action port [ 636.926859] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.926976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.927092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.927271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.927353] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.429453] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3 [ 637.429534] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.429642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.429700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.429902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.430040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.430095] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3 already deleted. [ 637.430180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2abb3b3-8c47-44c8-ad4b-b8edbe2a25c3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.135764] env[61538]: INFO networking_nsxv3.common.synchronization [None req-926e65d0-fa79-4dd5-8e6b-6150fd7a8c89 None None] Enqueued Resource ID: eee906aa-c4bd-4ae4-afa2-36d1919122df with Priority: HIGHEST for action port [ 638.136117] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee906aa-c4bd-4ae4-afa2-36d1919122df with Priority: HIGHEST for action port [ 638.136356] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-eee906aa-c4bd-4ae4-afa2-36d1919122df taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.136465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eee906aa-c4bd-4ae4-afa2-36d1919122df" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.136465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eee906aa-c4bd-4ae4-afa2-36d1919122df" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.136725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eee906aa-c4bd-4ae4-afa2-36d1919122df" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.136808] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eee906aa-c4bd-4ae4-afa2-36d1919122df',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.205239] env[61538]: INFO networking_nsxv3.common.synchronization [None req-df503e95-717b-4f8a-89bb-444c609946ba None None] Enqueued Resource ID: d8e69db5-7674-4862-a55a-baeed6321d8f with Priority: HIGHEST for action port [ 638.205239] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e69db5-7674-4862-a55a-baeed6321d8f with Priority: HIGHEST for action port [ 638.205239] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8e69db5-7674-4862-a55a-baeed6321d8f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.205239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8e69db5-7674-4862-a55a-baeed6321d8f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.205239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8e69db5-7674-4862-a55a-baeed6321d8f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.205239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8e69db5-7674-4862-a55a-baeed6321d8f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.205239] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8e69db5-7674-4862-a55a-baeed6321d8f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.641434] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eee906aa-c4bd-4ae4-afa2-36d1919122df [ 638.641434] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.641434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.641434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.641434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.641434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.641434] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eee906aa-c4bd-4ae4-afa2-36d1919122df already deleted. [ 638.641434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eee906aa-c4bd-4ae4-afa2-36d1919122df" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.712811] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8e69db5-7674-4862-a55a-baeed6321d8f [ 638.712811] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.712811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.712811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.712811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.712811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.712811] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8e69db5-7674-4862-a55a-baeed6321d8f already deleted. [ 638.712811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8e69db5-7674-4862-a55a-baeed6321d8f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.232051] env[61538]: INFO networking_nsxv3.common.synchronization [None req-78987735-2875-4665-8fa8-452cb1115091 None None] Enqueued Resource ID: 7a2aa8d0-5de2-4810-bda2-ad825e814f4c with Priority: HIGHEST for action port [ 639.232425] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2aa8d0-5de2-4810-bda2-ad825e814f4c with Priority: HIGHEST for action port [ 639.233058] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a2aa8d0-5de2-4810-bda2-ad825e814f4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.233248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a2aa8d0-5de2-4810-bda2-ad825e814f4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.233248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a2aa8d0-5de2-4810-bda2-ad825e814f4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.233441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a2aa8d0-5de2-4810-bda2-ad825e814f4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.233531] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a2aa8d0-5de2-4810-bda2-ad825e814f4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.737067] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a2aa8d0-5de2-4810-bda2-ad825e814f4c [ 639.737067] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.737067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.737067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.737330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.737405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.738032] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a2aa8d0-5de2-4810-bda2-ad825e814f4c already deleted. [ 639.738032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a2aa8d0-5de2-4810-bda2-ad825e814f4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.209698] env[61538]: INFO networking_nsxv3.common.synchronization [None req-7dd3b34a-eed9-4b10-bf47-2524a9fdb740 None None] Enqueued Resource ID: b527345f-94d0-42a0-a422-a4becd9ec8bf with Priority: HIGHEST for action port [ 640.210153] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b527345f-94d0-42a0-a422-a4becd9ec8bf with Priority: HIGHEST for action port [ 640.210447] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b527345f-94d0-42a0-a422-a4becd9ec8bf taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.210863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b527345f-94d0-42a0-a422-a4becd9ec8bf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.210863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b527345f-94d0-42a0-a422-a4becd9ec8bf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.211018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b527345f-94d0-42a0-a422-a4becd9ec8bf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.211018] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b527345f-94d0-42a0-a422-a4becd9ec8bf',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.714249] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b527345f-94d0-42a0-a422-a4becd9ec8bf [ 640.715834] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.715834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.715834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.715834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.715834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.715834] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b527345f-94d0-42a0-a422-a4becd9ec8bf already deleted. [ 640.715834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b527345f-94d0-42a0-a422-a4becd9ec8bf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.976947] env[61538]: INFO networking_nsxv3.common.synchronization [None req-484f96be-2177-4a14-a03e-56b63293783a None None] Enqueued Resource ID: eb4ac5b4-429b-45ab-8f76-7915d4e37c87 with Priority: HIGHEST for action port [ 640.979033] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb4ac5b4-429b-45ab-8f76-7915d4e37c87 with Priority: HIGHEST for action port [ 640.979033] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb4ac5b4-429b-45ab-8f76-7915d4e37c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.979033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb4ac5b4-429b-45ab-8f76-7915d4e37c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.979033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb4ac5b4-429b-45ab-8f76-7915d4e37c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.979685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb4ac5b4-429b-45ab-8f76-7915d4e37c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.980463] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb4ac5b4-429b-45ab-8f76-7915d4e37c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.482845] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb4ac5b4-429b-45ab-8f76-7915d4e37c87 [ 641.483102] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.483241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.483313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.483526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.483620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.483715] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb4ac5b4-429b-45ab-8f76-7915d4e37c87 already deleted. [ 641.483795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb4ac5b4-429b-45ab-8f76-7915d4e37c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.148032] env[61538]: INFO networking_nsxv3.common.synchronization [None req-07903699-da46-482e-afa6-215bc88cba84 None None] Enqueued Resource ID: 213b1464-1b21-4930-b340-06aad6138161 with Priority: HIGHEST for action port [ 642.148297] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 213b1464-1b21-4930-b340-06aad6138161 with Priority: HIGHEST for action port [ 642.150977] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-213b1464-1b21-4930-b340-06aad6138161 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.151136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-213b1464-1b21-4930-b340-06aad6138161" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.151206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-213b1464-1b21-4930-b340-06aad6138161" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.151901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-213b1464-1b21-4930-b340-06aad6138161" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.151901] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213b1464-1b21-4930-b340-06aad6138161',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.654971] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 213b1464-1b21-4930-b340-06aad6138161 [ 642.655231] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.655406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.655453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.655727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.656601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.656601] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:213b1464-1b21-4930-b340-06aad6138161 already deleted. [ 642.656601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-213b1464-1b21-4930-b340-06aad6138161" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.488118] env[61538]: INFO networking_nsxv3.common.synchronization [None req-7748e2e7-6074-4d29-942a-7786e1562491 None None] Enqueued Resource ID: 48280ad3-4595-4cd7-80b6-41760ce58835 with Priority: HIGHEST for action port [ 643.488118] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48280ad3-4595-4cd7-80b6-41760ce58835 with Priority: HIGHEST for action port [ 643.488118] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-48280ad3-4595-4cd7-80b6-41760ce58835 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.488118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48280ad3-4595-4cd7-80b6-41760ce58835" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.488118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48280ad3-4595-4cd7-80b6-41760ce58835" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.488118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48280ad3-4595-4cd7-80b6-41760ce58835" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.488118] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48280ad3-4595-4cd7-80b6-41760ce58835',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.990758] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48280ad3-4595-4cd7-80b6-41760ce58835 [ 643.991039] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.991289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.991366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.991576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.991671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.991779] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48280ad3-4595-4cd7-80b6-41760ce58835 already deleted. [ 643.991862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48280ad3-4595-4cd7-80b6-41760ce58835" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.647011] env[61538]: INFO networking_nsxv3.common.synchronization [None req-6c31ed29-8321-4636-930e-e4caca062fe4 None None] Enqueued Resource ID: ecca490a-d9c4-4f74-8c57-ce073a13e13c with Priority: HIGHEST for action port [ 644.648033] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecca490a-d9c4-4f74-8c57-ce073a13e13c with Priority: HIGHEST for action port [ 644.648342] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecca490a-d9c4-4f74-8c57-ce073a13e13c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.648413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecca490a-d9c4-4f74-8c57-ce073a13e13c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.648502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecca490a-d9c4-4f74-8c57-ce073a13e13c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.649084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecca490a-d9c4-4f74-8c57-ce073a13e13c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.649084] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecca490a-d9c4-4f74-8c57-ce073a13e13c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.030597] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c07fddc9-046e-422c-bd17-bb93f1b07fdb None None] Enqueued Resource ID: 458dcab6-a768-4db2-8086-fd3fa557887f with Priority: HIGHEST for action port [ 645.030597] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458dcab6-a768-4db2-8086-fd3fa557887f with Priority: HIGHEST for action port [ 645.030597] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-458dcab6-a768-4db2-8086-fd3fa557887f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.030597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-458dcab6-a768-4db2-8086-fd3fa557887f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.030597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-458dcab6-a768-4db2-8086-fd3fa557887f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.030597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-458dcab6-a768-4db2-8086-fd3fa557887f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.030597] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('458dcab6-a768-4db2-8086-fd3fa557887f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.150773] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecca490a-d9c4-4f74-8c57-ce073a13e13c [ 645.151017] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.151159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.151231] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.154161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.154161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.154161] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecca490a-d9c4-4f74-8c57-ce073a13e13c already deleted. [ 645.154161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecca490a-d9c4-4f74-8c57-ce073a13e13c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.533985] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 458dcab6-a768-4db2-8086-fd3fa557887f [ 645.534496] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.534496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.534496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.535128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.535231] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.535335] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:458dcab6-a768-4db2-8086-fd3fa557887f already deleted. [ 645.535416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-458dcab6-a768-4db2-8086-fd3fa557887f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.835454] env[61538]: INFO networking_nsxv3.common.synchronization [req-7263cf7f-cc8e-4e5a-95a4-892f85182895 req-e1b8c1cc-93b5-4db0-873e-63d6a2f15368 tempest-DeleteServersAdminTestJSON-1595240936 tempest-DeleteServersAdminTestJSON-1595240936-project-member] Enqueued Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 645.835454] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 645.835454] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.835454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.835454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.835454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.835454] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.835454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.835454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.839386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.839386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.839386] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.058644] env[61538]: INFO networking_nsxv3.common.synchronization [None req-ca4c3bc4-4c5e-401a-ba33-8edda752292d None None] Enqueued Resource ID: d06638f1-7a97-4d73-92cd-d101e0038db4 with Priority: HIGHEST for action port [ 646.059440] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d06638f1-7a97-4d73-92cd-d101e0038db4 with Priority: HIGHEST for action port [ 646.059773] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d06638f1-7a97-4d73-92cd-d101e0038db4 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.059894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d06638f1-7a97-4d73-92cd-d101e0038db4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.060119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d06638f1-7a97-4d73-92cd-d101e0038db4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.061712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d06638f1-7a97-4d73-92cd-d101e0038db4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.061804] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d06638f1-7a97-4d73-92cd-d101e0038db4',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.341446] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.341619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.341693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.341921] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.342033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.342233] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.342334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.342398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.342581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.342658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.342748] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d already deleted. [ 646.342834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.568423] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d06638f1-7a97-4d73-92cd-d101e0038db4 [ 646.568850] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.568951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.569020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.569785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.569785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.569785] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d06638f1-7a97-4d73-92cd-d101e0038db4 already deleted. [ 646.569785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d06638f1-7a97-4d73-92cd-d101e0038db4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.723725] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.723725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.723869] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.725756] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.726067] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.726244] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.726367] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.726621] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.726818] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.727344] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.727344] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.727450] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.727488] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.727574] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.727678] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.728121] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.754644] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.754840] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 646.755270] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.755605] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.755889] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-d548df43-1a40-42e8-88e2-6487812a1612 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.756249] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-d548df43-1a40-42e8-88e2-6487812a1612" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.756249] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-d548df43-1a40-42e8-88e2-6487812a1612" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.756886] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-d548df43-1a40-42e8-88e2-6487812a1612" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.756886] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d548df43-1a40-42e8-88e2-6487812a1612',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.145678] env[61538]: INFO networking_nsxv3.common.synchronization [None req-30f2849d-3f8d-4dcf-b095-8711e8bac6d0 None None] Enqueued Resource ID: 072d3b0b-5ba4-4f1f-be6d-85ebefbc6843 with Priority: HIGHEST for action port [ 647.145678] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 072d3b0b-5ba4-4f1f-be6d-85ebefbc6843 with Priority: HIGHEST for action port [ 647.146836] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-072d3b0b-5ba4-4f1f-be6d-85ebefbc6843 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.146996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-072d3b0b-5ba4-4f1f-be6d-85ebefbc6843" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.147087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-072d3b0b-5ba4-4f1f-be6d-85ebefbc6843" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.147343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-072d3b0b-5ba4-4f1f-be6d-85ebefbc6843" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.147580] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('072d3b0b-5ba4-4f1f-be6d-85ebefbc6843',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.260159] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.260313] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.260384] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.260985] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.261160] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.261323] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port d548df43-1a40-42e8-88e2-6487812a1612 not found, creating... [ 647.261607] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.261771] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.261888] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.262306] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.262450] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.262896] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.263069] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.263188] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.263408] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.263540] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.263692] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: d548df43-1a40-42e8-88e2-6487812a1612 is going to be created. [ 647.306450] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.306721] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.306887] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.307232] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.309031] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.309031] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-d548df43-1a40-42e8-88e2-6487812a1612" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.358212] env[61538]: INFO networking_nsxv3.common.synchronization [None req-2ec68a35-14d6-4024-a500-9dfb750ebfd4 None None] Enqueued Resource ID: 5493ca87-0ea5-4009-80e3-339b4977af33 with Priority: HIGHEST for action port [ 647.358811] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5493ca87-0ea5-4009-80e3-339b4977af33 with Priority: HIGHEST for action port [ 647.359217] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5493ca87-0ea5-4009-80e3-339b4977af33 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.359357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5493ca87-0ea5-4009-80e3-339b4977af33" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.359424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5493ca87-0ea5-4009-80e3-339b4977af33" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.359696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5493ca87-0ea5-4009-80e3-339b4977af33" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.359776] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5493ca87-0ea5-4009-80e3-339b4977af33',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.650372] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 072d3b0b-5ba4-4f1f-be6d-85ebefbc6843 [ 647.650372] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.650717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.651113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.651173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.651249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.651380] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:072d3b0b-5ba4-4f1f-be6d-85ebefbc6843 already deleted. [ 647.651474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-072d3b0b-5ba4-4f1f-be6d-85ebefbc6843" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.863482] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5493ca87-0ea5-4009-80e3-339b4977af33 [ 647.863724] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.865709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.865709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.865709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.865709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.865709] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5493ca87-0ea5-4009-80e3-339b4977af33 already deleted. [ 647.865709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5493ca87-0ea5-4009-80e3-339b4977af33" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.937872] env[61538]: INFO networking_nsxv3.common.synchronization [req-9c21f804-cfd2-463e-85e3-8add98f23782 req-407867b5-6b46-4090-8b27-ccab3b47d3a6 tempest-ServerDiagnosticsNegativeTest-1080856404 tempest-ServerDiagnosticsNegativeTest-1080856404-project-member] Enqueued Resource ID: 0af22a35-c045-464f-ae65-fa54f84e116a with Priority: HIGHEST for action security_group_members [ 647.940126] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af22a35-c045-464f-ae65-fa54f84e116a with Priority: HIGHEST for action security_group_members [ 647.941614] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af22a35-c045-464f-ae65-fa54f84e116a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.943430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.943497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.943755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.943932] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.944447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.944524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.944749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.944791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.944889] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af22a35-c045-464f-ae65-fa54f84e116a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.333456] env[61538]: INFO networking_nsxv3.common.synchronization [None req-15a7d961-03b8-44cd-b40a-db638c8c2170 tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 648.334086] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 648.334414] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.334579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.334643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.334920] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.335017] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.440207] env[61538]: INFO networking_nsxv3.common.synchronization [None req-3a2cb8af-cbae-401a-90f0-fa51642825d9 tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 648.440207] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 648.440207] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.440207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.448023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.448596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.448713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.449583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.449583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.450654] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.450654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.451406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.451406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.451406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.451406] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af22a35-c045-464f-ae65-fa54f84e116a already deleted. [ 648.451406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.860944] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.861148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.861190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.861440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.861495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.861592] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 already deleted. [ 648.861704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.861878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.862055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.862143] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.937965] env[61538]: INFO networking_nsxv3.common.synchronization [req-7263cf7f-cc8e-4e5a-95a4-892f85182895 req-a0cb26d4-97ef-4b6e-842e-addfc13a080d service nova] Enqueued Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_rules [ 648.938215] env[61538]: INFO networking_nsxv3.common.synchronization [req-7263cf7f-cc8e-4e5a-95a4-892f85182895 req-a0cb26d4-97ef-4b6e-842e-addfc13a080d service nova] Enqueued Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 648.938215] env[61538]: INFO networking_nsxv3.common.synchronization [req-7263cf7f-cc8e-4e5a-95a4-892f85182895 req-a0cb26d4-97ef-4b6e-842e-addfc13a080d service nova] Enqueued Resource ID: d548df43-1a40-42e8-88e2-6487812a1612 with Priority: HIGHEST for action port [ 648.938749] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_rules [ 648.938749] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 648.938749] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d548df43-1a40-42e8-88e2-6487812a1612 with Priority: HIGHEST for action port [ 648.939151] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.939269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.939335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.939578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.939665] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.943542] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.943660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.943729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.943901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.944098] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.944173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.944396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.944396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.944504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.944543] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.945642] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d548df43-1a40-42e8-88e2-6487812a1612 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.945788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d548df43-1a40-42e8-88e2-6487812a1612" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.945979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d548df43-1a40-42e8-88e2-6487812a1612" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.945979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d548df43-1a40-42e8-88e2-6487812a1612" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.950127] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d548df43-1a40-42e8-88e2-6487812a1612',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.124319] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.124643] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.124643] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.125132] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.125323] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.125586] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.125768] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.126545] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.126749] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.127324] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.128091] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.129480] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.129670] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.129900] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.130173] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.130413] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.151391] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.155016] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.155016] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.155016] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.155016] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-25b3b54b-4b63-407e-bd50-625dca707982 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.155016] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-25b3b54b-4b63-407e-bd50-625dca707982" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.155397] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-25b3b54b-4b63-407e-bd50-625dca707982" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.155714] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-25b3b54b-4b63-407e-bd50-625dca707982" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.155919] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25b3b54b-4b63-407e-bd50-625dca707982',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.386710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.387082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.387082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.387169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.387474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.387474] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 already deleted. [ 649.387474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.452920] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.453042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.462493] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.463425] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d548df43-1a40-42e8-88e2-6487812a1612 with status ACTIVE [ 649.463645] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.463759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.463993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.464043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.464146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.464332] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.464418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.464486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.464793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.464906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.465130] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.465234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.465300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.465506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.465558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.465692] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d548df43-1a40-42e8-88e2-6487812a1612 is going to be updated. [ 649.490484] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.491120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.491120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.491120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.491120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.491296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d548df43-1a40-42e8-88e2-6487812a1612" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.658625] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.658959] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.659019] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.659321] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.659491] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.659654] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 25b3b54b-4b63-407e-bd50-625dca707982 not found, creating... [ 649.659931] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.660108] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.660234] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.660464] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.660605] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.660961] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.661703] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.661891] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.662743] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.662743] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.662743] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 25b3b54b-4b63-407e-bd50-625dca707982 is going to be created. [ 649.687861] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.687861] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.687988] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.688682] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.688682] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.688682] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-25b3b54b-4b63-407e-bd50-625dca707982" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.968254] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.475604] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.476010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.476010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.476604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.476721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.476834] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d is going to be created. [ 650.576832] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.576981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.577074] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.577309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.577462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.597137] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: UNINITIALIZED for 2s [ 650.599944] env[61538]: INFO networking_nsxv3.common.synchronization [None req-2ae152e2-d126-4019-b5a0-5122ead7696c None None] Enqueued Resource ID: bfa013e7-4c8c-4c65-ae37-17314d047ceb with Priority: HIGHEST for action port [ 650.600525] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa013e7-4c8c-4c65-ae37-17314d047ceb with Priority: HIGHEST for action port [ 650.600890] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfa013e7-4c8c-4c65-ae37-17314d047ceb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.600890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfa013e7-4c8c-4c65-ae37-17314d047ceb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.601024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfa013e7-4c8c-4c65-ae37-17314d047ceb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.601233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfa013e7-4c8c-4c65-ae37-17314d047ceb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.601318] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfa013e7-4c8c-4c65-ae37-17314d047ceb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.847382] env[61538]: INFO networking_nsxv3.common.synchronization [None req-eb640ffb-eeda-41b9-a4ff-03980ab79211 None None] Enqueued Resource ID: d8200bea-5f91-48de-a20c-4d019708c18b with Priority: HIGHEST for action port [ 650.847641] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8200bea-5f91-48de-a20c-4d019708c18b with Priority: HIGHEST for action port [ 650.848251] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8200bea-5f91-48de-a20c-4d019708c18b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.848493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8200bea-5f91-48de-a20c-4d019708c18b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.848493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8200bea-5f91-48de-a20c-4d019708c18b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.848688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8200bea-5f91-48de-a20c-4d019708c18b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.848767] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8200bea-5f91-48de-a20c-4d019708c18b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.103593] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfa013e7-4c8c-4c65-ae37-17314d047ceb [ 651.104341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.104484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.104571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.106942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.106942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.106942] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfa013e7-4c8c-4c65-ae37-17314d047ceb already deleted. [ 651.106942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfa013e7-4c8c-4c65-ae37-17314d047ceb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.282169] env[61538]: INFO networking_nsxv3.common.synchronization [req-79cde313-821e-447d-bf08-8bc0cc30fc82 req-94ff57f1-b638-45c6-8899-86ee43579274 tempest-TenantUsagesTestJSON-197157338 tempest-TenantUsagesTestJSON-197157338-project-member] Enqueued Resource ID: acdbba8b-e86f-40a9-8892-22733abd6f87 with Priority: HIGHEST for action security_group_members [ 651.284429] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdbba8b-e86f-40a9-8892-22733abd6f87 with Priority: HIGHEST for action security_group_members [ 651.284979] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbba8b-e86f-40a9-8892-22733abd6f87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.286375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.286375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.286375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.286375] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.286375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.286375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.286375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.286375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.289053] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acdbba8b-e86f-40a9-8892-22733abd6f87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.354120] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8200bea-5f91-48de-a20c-4d019708c18b [ 651.355755] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.355755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.355755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.355755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.355755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.355755] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8200bea-5f91-48de-a20c-4d019708c18b already deleted. [ 651.355755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8200bea-5f91-48de-a20c-4d019708c18b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.577032] env[61538]: INFO networking_nsxv3.common.synchronization [req-9c21f804-cfd2-463e-85e3-8add98f23782 req-72ed299c-d5b5-43a9-a791-ba4bfb4d9b8d service nova] Enqueued Resource ID: 0af22a35-c045-464f-ae65-fa54f84e116a with Priority: HIGHEST for action security_group_rules [ 651.577032] env[61538]: INFO networking_nsxv3.common.synchronization [req-9c21f804-cfd2-463e-85e3-8add98f23782 req-72ed299c-d5b5-43a9-a791-ba4bfb4d9b8d service nova] Enqueued Resource ID: 0af22a35-c045-464f-ae65-fa54f84e116a with Priority: HIGHEST for action security_group_members [ 651.578120] env[61538]: INFO networking_nsxv3.common.synchronization [req-9c21f804-cfd2-463e-85e3-8add98f23782 req-72ed299c-d5b5-43a9-a791-ba4bfb4d9b8d service nova] Enqueued Resource ID: 25b3b54b-4b63-407e-bd50-625dca707982 with Priority: HIGHEST for action port [ 651.578120] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af22a35-c045-464f-ae65-fa54f84e116a with Priority: HIGHEST for action security_group_rules [ 651.578120] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af22a35-c045-464f-ae65-fa54f84e116a with Priority: HIGHEST for action security_group_members [ 651.578120] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b3b54b-4b63-407e-bd50-625dca707982 with Priority: HIGHEST for action port [ 651.579699] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af22a35-c045-464f-ae65-fa54f84e116a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.584725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.584725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.584725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.584725] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af22a35-c045-464f-ae65-fa54f84e116a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.584725] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af22a35-c045-464f-ae65-fa54f84e116a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.584725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.584725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.584725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.585086] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.585086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.585086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.585229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.585229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.585289] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af22a35-c045-464f-ae65-fa54f84e116a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.586313] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-25b3b54b-4b63-407e-bd50-625dca707982 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.586313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25b3b54b-4b63-407e-bd50-625dca707982" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.588858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25b3b54b-4b63-407e-bd50-625dca707982" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.588858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25b3b54b-4b63-407e-bd50-625dca707982" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.588858] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25b3b54b-4b63-407e-bd50-625dca707982',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.792664] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.792880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.792950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.793227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.793327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.793529] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.793620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.793686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.794368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.794368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.794368] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acdbba8b-e86f-40a9-8892-22733abd6f87 already deleted. [ 651.794368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.092838] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af22a35-c045-464f-ae65-fa54f84e116a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.092976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.093190] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af22a35-c045-464f-ae65-fa54f84e116a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.094903] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25b3b54b-4b63-407e-bd50-625dca707982 with status ACTIVE [ 652.097632] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.097632] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.097632] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.097632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.097632] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25b3b54b-4b63-407e-bd50-625dca707982 is going to be updated. [ 652.125783] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.125979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.126040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.126546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.126853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.126853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25b3b54b-4b63-407e-bd50-625dca707982" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.130433] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.130628] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.130784] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.130999] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.131316] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.131479] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.131597] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.131827] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.131977] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.132841] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.132970] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.133173] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.133268] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.133471] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.133471] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.133606] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.155232] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.155811] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 652.155982] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.159171] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.159540] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-72abf1ec-6ac4-4654-b096-bdfb06c58f03 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.159730] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-72abf1ec-6ac4-4654-b096-bdfb06c58f03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.160043] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-72abf1ec-6ac4-4654-b096-bdfb06c58f03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.160178] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-72abf1ec-6ac4-4654-b096-bdfb06c58f03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.160321] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72abf1ec-6ac4-4654-b096-bdfb06c58f03',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.562068] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c434593c-d227-4bee-828b-305f53ab3bac tempest-VolumesAssistedSnapshotsTest-760021604 tempest-VolumesAssistedSnapshotsTest-760021604-project-member] Enqueued Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_rules [ 652.562664] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_rules [ 652.562955] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.564932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.565020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.565286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.565367] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.602806] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af22a35-c045-464f-ae65-fa54f84e116a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.615940] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: SUCCESS [ 652.615940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.615940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.615940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.615940] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.616377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.616377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.616377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.616377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.616377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.616791] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.663402] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.663632] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.663758] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.664074] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.664231] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.664384] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 72abf1ec-6ac4-4654-b096-bdfb06c58f03 not found, creating... [ 652.664749] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.665090] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.665090] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.665568] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.665568] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.665730] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.665867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.665988] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.666423] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.666569] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.666715] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 72abf1ec-6ac4-4654-b096-bdfb06c58f03 is going to be created. [ 652.688976] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.689205] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.689867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.689867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.689867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.690191] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-72abf1ec-6ac4-4654-b096-bdfb06c58f03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.707106] env[61538]: INFO networking_nsxv3.common.synchronization [None req-8e6c6779-6237-4184-afbb-70b5a07416b3 tempest-VolumesAssistedSnapshotsTest-760021604 tempest-VolumesAssistedSnapshotsTest-760021604-project-member] Enqueued Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_rules [ 652.707609] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_rules [ 652.707981] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.708074] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.090191] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.091235] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.091395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.092031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.092031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.092031] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff already deleted. [ 653.092031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.092031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.092238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.092238] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.108573] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.108736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.108798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.109000] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.109122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.109220] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af22a35-c045-464f-ae65-fa54f84e116a is going to be created. [ 653.119392] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.119861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.119984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.120485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.121132] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.121391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.121470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.121650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.121745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.121837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.122093] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.122306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.122306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.122936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.123247] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.123247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.123355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.123538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.123659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.123767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.123912] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.139874] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.140567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.140567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.140833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.140916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.151310] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af22a35-c045-464f-ae65-fa54f84e116a in Status: UNINITIALIZED for 2s [ 653.200191] env[61538]: INFO networking_nsxv3.common.synchronization [None req-eda8f70f-08b9-4fed-89e4-e69a893bbce9 None None] Enqueued Resource ID: db63d440-8ea6-4fc0-8132-0a5dbb5ce18e with Priority: HIGHEST for action port [ 653.203063] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db63d440-8ea6-4fc0-8132-0a5dbb5ce18e with Priority: HIGHEST for action port [ 653.203063] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-db63d440-8ea6-4fc0-8132-0a5dbb5ce18e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.203063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db63d440-8ea6-4fc0-8132-0a5dbb5ce18e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.203063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db63d440-8ea6-4fc0-8132-0a5dbb5ce18e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.203063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db63d440-8ea6-4fc0-8132-0a5dbb5ce18e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.203063] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db63d440-8ea6-4fc0-8132-0a5dbb5ce18e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.314657] env[61538]: INFO networking_nsxv3.common.synchronization [req-855b2950-aa73-48c8-8ea2-29a19a4c0826 req-9a01c3a9-5c04-4521-bf62-1ff31ce4ee4a tempest-ServerDiagnosticsTest-463569044 tempest-ServerDiagnosticsTest-463569044-project-member] Enqueued Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGHEST for action security_group_members [ 653.315933] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGHEST for action security_group_members [ 653.315933] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11683c57-c820-44f9-8374-c60833d4038c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.315933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.315933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.316321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.317280] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.317280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.317280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.317280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.317280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.317280] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11683c57-c820-44f9-8374-c60833d4038c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.459825] env[61538]: INFO networking_nsxv3.common.synchronization [None req-78283235-7118-4b16-8b96-4f32420f4f9a None None] Enqueued Resource ID: 33076ce3-12a7-4152-b0b0-7831bfa6df03 with Priority: HIGHEST for action port [ 653.460535] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33076ce3-12a7-4152-b0b0-7831bfa6df03 with Priority: HIGHEST for action port [ 653.461250] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-33076ce3-12a7-4152-b0b0-7831bfa6df03 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.461250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33076ce3-12a7-4152-b0b0-7831bfa6df03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.461250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33076ce3-12a7-4152-b0b0-7831bfa6df03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.461445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33076ce3-12a7-4152-b0b0-7831bfa6df03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.462034] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33076ce3-12a7-4152-b0b0-7831bfa6df03',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.616484] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.616848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.616848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.616922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.617024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.617118] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff already deleted. [ 653.617197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.626026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1447a613-37bb-4237-a379-2b84dc1ad40d: rpc.has_security_group_logging(os_id): False [ 653.649785] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.649945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.650016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.650704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.650704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.650704] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.650704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.650704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.651239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.651239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.651239] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.651239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.651239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.651492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.651492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.651755] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.652611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.654812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.654997] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.655098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.655192] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d is going to be created. [ 653.705346] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db63d440-8ea6-4fc0-8132-0a5dbb5ce18e [ 653.705346] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.705520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.705520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.706181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.706181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.706181] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db63d440-8ea6-4fc0-8132-0a5dbb5ce18e already deleted. [ 653.706181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db63d440-8ea6-4fc0-8132-0a5dbb5ce18e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.756800] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.756800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.756800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.756986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.757110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.771979] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: IN_PROGRESS for 2s [ 653.819441] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.819662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.819738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.819996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.820222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.820312] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.820411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.820472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.820646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.820734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.820828] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11683c57-c820-44f9-8374-c60833d4038c already deleted. [ 653.820911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.970893] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33076ce3-12a7-4152-b0b0-7831bfa6df03 [ 653.970893] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.970893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.970893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.970893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.970893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.970893] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33076ce3-12a7-4152-b0b0-7831bfa6df03 already deleted. [ 653.970893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33076ce3-12a7-4152-b0b0-7831bfa6df03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.976192] env[61538]: INFO networking_nsxv3.common.synchronization [req-79cde313-821e-447d-bf08-8bc0cc30fc82 req-d21a0b93-b678-4755-b61e-bebd7bb25759 service nova] Enqueued Resource ID: acdbba8b-e86f-40a9-8892-22733abd6f87 with Priority: HIGHEST for action security_group_rules [ 653.976410] env[61538]: INFO networking_nsxv3.common.synchronization [req-79cde313-821e-447d-bf08-8bc0cc30fc82 req-d21a0b93-b678-4755-b61e-bebd7bb25759 service nova] Enqueued Resource ID: acdbba8b-e86f-40a9-8892-22733abd6f87 with Priority: HIGHEST for action security_group_members [ 653.976559] env[61538]: INFO networking_nsxv3.common.synchronization [req-79cde313-821e-447d-bf08-8bc0cc30fc82 req-d21a0b93-b678-4755-b61e-bebd7bb25759 service nova] Enqueued Resource ID: 72abf1ec-6ac4-4654-b096-bdfb06c58f03 with Priority: HIGHEST for action port [ 653.977323] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdbba8b-e86f-40a9-8892-22733abd6f87 with Priority: HIGHEST for action security_group_rules [ 653.977323] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdbba8b-e86f-40a9-8892-22733abd6f87 with Priority: HIGHEST for action security_group_members [ 653.977497] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72abf1ec-6ac4-4654-b096-bdfb06c58f03 with Priority: HIGHEST for action port [ 653.977715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acdbba8b-e86f-40a9-8892-22733abd6f87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.977848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.977938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.978198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.978281] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acdbba8b-e86f-40a9-8892-22733abd6f87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.980344] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbba8b-e86f-40a9-8892-22733abd6f87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.980491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.980567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.980847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.981275] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.981358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.981421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.981580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.981665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.982104] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acdbba8b-e86f-40a9-8892-22733abd6f87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.982757] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-72abf1ec-6ac4-4654-b096-bdfb06c58f03 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.982890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72abf1ec-6ac4-4654-b096-bdfb06c58f03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.982961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72abf1ec-6ac4-4654-b096-bdfb06c58f03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.983240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72abf1ec-6ac4-4654-b096-bdfb06c58f03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.983295] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72abf1ec-6ac4-4654-b096-bdfb06c58f03',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.152941] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.154371] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.154534] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.154865] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.156458] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.157240] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.157744] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.161999] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.161999] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.161999] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.161999] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.161999] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.161999] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.161999] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.161999] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.161999] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.184074] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.184264] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.186020] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.186020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.186020] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-bd5363b5-74ac-467c-9834-a90fbaf697db taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.186020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-bd5363b5-74ac-467c-9834-a90fbaf697db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.186020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-bd5363b5-74ac-467c-9834-a90fbaf697db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.186020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-bd5363b5-74ac-467c-9834-a90fbaf697db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.186020] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd5363b5-74ac-467c-9834-a90fbaf697db',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.488460] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acdbba8b-e86f-40a9-8892-22733abd6f87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.493725] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbba8b-e86f-40a9-8892-22733abd6f87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.493725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.493725] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72abf1ec-6ac4-4654-b096-bdfb06c58f03 with status ACTIVE [ 654.493725] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.493725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.493725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.493725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.493725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.493725] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.493725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.493725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.493725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.493725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.493725] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.494337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.494337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.494337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.494337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.494337] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72abf1ec-6ac4-4654-b096-bdfb06c58f03 is going to be updated. [ 654.522481] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.522642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.522715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.522936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.523091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.523248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72abf1ec-6ac4-4654-b096-bdfb06c58f03" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.689708] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.689708] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.689708] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.690083] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.690142] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.690294] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port bd5363b5-74ac-467c-9834-a90fbaf697db not found, creating... [ 654.692777] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.692777] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.692777] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.692777] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.692777] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.692777] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.692777] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.692777] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.694598] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.694846] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.695764] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: bd5363b5-74ac-467c-9834-a90fbaf697db is going to be created. [ 654.730649] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.730649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.730649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.730649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.730649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.730649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-bd5363b5-74ac-467c-9834-a90fbaf697db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.776569] env[61538]: INFO networking_nsxv3.common.synchronization [None req-e989355b-bd37-4e72-b0f5-8d3f46ac52c2 None None] Enqueued Resource ID: c83341ea-01b6-4902-951f-420ebcc17941 with Priority: HIGHEST for action port [ 654.776569] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83341ea-01b6-4902-951f-420ebcc17941 with Priority: HIGHEST for action port [ 654.776569] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-c83341ea-01b6-4902-951f-420ebcc17941 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.776569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c83341ea-01b6-4902-951f-420ebcc17941" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.776569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c83341ea-01b6-4902-951f-420ebcc17941" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.776827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c83341ea-01b6-4902-951f-420ebcc17941" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.776827] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c83341ea-01b6-4902-951f-420ebcc17941',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.991685] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acdbba8b-e86f-40a9-8892-22733abd6f87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.165130] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af22a35-c045-464f-ae65-fa54f84e116a in Status: SUCCESS [ 655.165347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.165543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.165792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.166502] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.166502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.166502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.166502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.166502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.166788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.166788] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0af22a35-c045-464f-ae65-fa54f84e116a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.282377] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c83341ea-01b6-4902-951f-420ebcc17941 [ 655.282377] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.282377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.282377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.282377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.282377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.282377] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c83341ea-01b6-4902-951f-420ebcc17941 already deleted. [ 655.282377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c83341ea-01b6-4902-951f-420ebcc17941" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.495513] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.496344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.496538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.496834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.496887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.496964] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acdbba8b-e86f-40a9-8892-22733abd6f87 is going to be created. [ 655.526990] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.527180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.527244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.527418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.527953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.539910] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acdbba8b-e86f-40a9-8892-22733abd6f87 in Status: UNINITIALIZED for 2s [ 655.673638] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af22a35-c045-464f-ae65-fa54f84e116a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.673964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.673964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.674126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.674307] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.674430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.674492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.674679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.674789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.674878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.675844] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af22a35-c045-464f-ae65-fa54f84e116a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.675844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.675844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.675844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.675844] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.675844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.675844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.675844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.675844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.676586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.676586] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0af22a35-c045-464f-ae65-fa54f84e116a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.788606] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: SUCCESS [ 655.788871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.155924] env[61538]: INFO networking_nsxv3.common.synchronization [req-855b2950-aa73-48c8-8ea2-29a19a4c0826 req-75589534-8a39-4c37-b1a4-e04fb5fa3fc8 service nova] Enqueued Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGHEST for action security_group_rules [ 656.156392] env[61538]: INFO networking_nsxv3.common.synchronization [req-855b2950-aa73-48c8-8ea2-29a19a4c0826 req-75589534-8a39-4c37-b1a4-e04fb5fa3fc8 service nova] Enqueued Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGHEST for action security_group_members [ 656.156563] env[61538]: INFO networking_nsxv3.common.synchronization [req-855b2950-aa73-48c8-8ea2-29a19a4c0826 req-75589534-8a39-4c37-b1a4-e04fb5fa3fc8 service nova] Enqueued Resource ID: bd5363b5-74ac-467c-9834-a90fbaf697db with Priority: HIGHEST for action port [ 656.157695] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGHEST for action security_group_rules [ 656.157945] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGHEST for action security_group_members [ 656.158291] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd5363b5-74ac-467c-9834-a90fbaf697db with Priority: HIGHEST for action port [ 656.158642] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11683c57-c820-44f9-8374-c60833d4038c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.158780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.158843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.159113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.159199] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11683c57-c820-44f9-8374-c60833d4038c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.162139] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11683c57-c820-44f9-8374-c60833d4038c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.162139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.162139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.162139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.162139] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.162139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.162139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.162139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.162607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.162607] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11683c57-c820-44f9-8374-c60833d4038c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.163278] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd5363b5-74ac-467c-9834-a90fbaf697db taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.163430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd5363b5-74ac-467c-9834-a90fbaf697db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.163479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd5363b5-74ac-467c-9834-a90fbaf697db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.164458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd5363b5-74ac-467c-9834-a90fbaf697db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.164458] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd5363b5-74ac-467c-9834-a90fbaf697db',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.182402] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0af22a35-c045-464f-ae65-fa54f84e116a: rpc.has_security_group_logging(os_id): False [ 656.201233] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.201761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.201934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.202848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.202848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.205902] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.205902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.205902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.205902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.205902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.205902] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.205902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.205902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.205902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.205902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.205902] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.205902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.206376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.206376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.206436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.206522] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af22a35-c045-464f-ae65-fa54f84e116a is going to be created. [ 656.280459] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.280630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.280703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.280916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.281116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.297991] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af22a35-c045-464f-ae65-fa54f84e116a in Status: IN_PROGRESS for 2s [ 656.556953] env[61538]: INFO networking_nsxv3.common.synchronization [None req-4d011581-2365-4483-85f3-765d2959e4cf None None] Enqueued Resource ID: ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b with Priority: HIGHEST for action port [ 656.557043] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b with Priority: HIGHEST for action port [ 656.558091] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.558091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.558091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.558825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.559363] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.667287] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11683c57-c820-44f9-8374-c60833d4038c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.667287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.667287] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11683c57-c820-44f9-8374-c60833d4038c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.667443] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd5363b5-74ac-467c-9834-a90fbaf697db with status ACTIVE [ 656.667724] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.667724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.667724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.668015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.668015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.668226] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.668299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.668330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.668616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.668616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.668715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.668807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.669356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.669356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.669596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.669596] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd5363b5-74ac-467c-9834-a90fbaf697db is going to be updated. [ 656.691191] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.691309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.691395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.693057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.693057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.693057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd5363b5-74ac-467c-9834-a90fbaf697db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.065080] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b [ 657.065080] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.065080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.065080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.065080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.065669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.065669] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b already deleted. [ 657.065669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab84b2aa-e7b4-4d87-9b15-ec888c2fe83b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.171378] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11683c57-c820-44f9-8374-c60833d4038c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.258226] env[61538]: INFO networking_nsxv3.common.synchronization [None req-ff43e3ad-2029-48e5-9173-106c2ca0595c None None] Enqueued Resource ID: 24da042a-a0a8-4340-96df-27ec3de0b214 with Priority: HIGHEST for action port [ 657.258226] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24da042a-a0a8-4340-96df-27ec3de0b214 with Priority: HIGHEST for action port [ 657.258226] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-24da042a-a0a8-4340-96df-27ec3de0b214 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.258226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24da042a-a0a8-4340-96df-27ec3de0b214" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.258226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24da042a-a0a8-4340-96df-27ec3de0b214" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.258226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24da042a-a0a8-4340-96df-27ec3de0b214" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.258584] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24da042a-a0a8-4340-96df-27ec3de0b214',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.523853] env[61538]: INFO networking_nsxv3.common.synchronization [None req-8f6bc900-9475-45d7-8a4d-dd0f630d2c0f None None] Enqueued Resource ID: f1dafa44-8300-4e60-af9c-5ba9d2d77385 with Priority: HIGHEST for action port [ 657.524373] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1dafa44-8300-4e60-af9c-5ba9d2d77385 with Priority: HIGHEST for action port [ 657.524686] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1dafa44-8300-4e60-af9c-5ba9d2d77385 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.524830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1dafa44-8300-4e60-af9c-5ba9d2d77385" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.524895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1dafa44-8300-4e60-af9c-5ba9d2d77385" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.525536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1dafa44-8300-4e60-af9c-5ba9d2d77385" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.525701] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1dafa44-8300-4e60-af9c-5ba9d2d77385',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.565233] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acdbba8b-e86f-40a9-8892-22733abd6f87 in Status: SUCCESS [ 657.565466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.565631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.565852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.566057] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.566219] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.566287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.566444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.566535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.566622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.566710] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acdbba8b-e86f-40a9-8892-22733abd6f87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.629118] env[61538]: INFO networking_nsxv3.common.synchronization [None req-2bae31e3-6446-4137-8721-0d5d713fe0df tempest-ServersTestFqdnHostnames-1717368552 tempest-ServersTestFqdnHostnames-1717368552-project-member] Enqueued Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_rules [ 657.633781] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_rules [ 657.633781] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850cf150-e9b7-4aa9-8141-ddd003b7e560 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.633781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.633781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.634952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.634952] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.676107] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.676107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.676107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.676107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.676107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.676107] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11683c57-c820-44f9-8374-c60833d4038c is going to be created. [ 657.705274] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.705274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.705274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.705274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.705274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.719827] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11683c57-c820-44f9-8374-c60833d4038c in Status: UNINITIALIZED for 2s [ 657.746722] env[61538]: INFO networking_nsxv3.common.synchronization [req-eacad240-efe8-4577-b004-d6e386663492 req-d12159b1-21a1-4da1-936e-df6a04234c96 tempest-MigrationsAdminTest-1836932771 tempest-MigrationsAdminTest-1836932771-project-member] Enqueued Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 657.747580] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 657.747724] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.747802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.747802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.749093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.749307] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.749420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.749570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.749757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.750468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.750940] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.765106] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24da042a-a0a8-4340-96df-27ec3de0b214 [ 657.765106] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.765106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.765106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.765106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.765106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.765106] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24da042a-a0a8-4340-96df-27ec3de0b214 already deleted. [ 657.765106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24da042a-a0a8-4340-96df-27ec3de0b214" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.955437] env[61538]: INFO networking_nsxv3.common.synchronization [None req-691aefb6-c470-43df-8c0a-05c2af9ec68c tempest-ServersTestFqdnHostnames-1717368552 tempest-ServersTestFqdnHostnames-1717368552-project-member] Enqueued Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_rules [ 657.955973] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_rules [ 657.956479] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850cf150-e9b7-4aa9-8141-ddd003b7e560 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.956591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.030126] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1dafa44-8300-4e60-af9c-5ba9d2d77385 [ 658.030126] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.030126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.030126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.030126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.030126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.030126] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1dafa44-8300-4e60-af9c-5ba9d2d77385 already deleted. [ 658.030126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1dafa44-8300-4e60-af9c-5ba9d2d77385" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.071847] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbba8b-e86f-40a9-8892-22733abd6f87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.072961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.072961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.072961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.072961] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.072961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.072961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.072961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.072961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.073360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.073360] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbba8b-e86f-40a9-8892-22733abd6f87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.073360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.073360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.073555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.073644] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.074022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.074022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.074022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.074022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.075355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.075355] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acdbba8b-e86f-40a9-8892-22733abd6f87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.160889] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.161100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.161169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.161343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.161429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.161525] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 already deleted. [ 658.161606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.161754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.161903] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.161986] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.253966] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.253966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.253966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.253966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.253966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.254246] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.254246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.254330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.254486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.254486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.254590] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 580370e7-ea25-4027-912b-de772679071c already deleted. [ 658.254644] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.317752] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af22a35-c045-464f-ae65-fa54f84e116a in Status: SUCCESS [ 658.317752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.581419] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acdbba8b-e86f-40a9-8892-22733abd6f87: rpc.has_security_group_logging(os_id): False [ 658.635817] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.636184] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.636322] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.636666] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.636971] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.638892] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.639116] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.639523] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.639733] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.640036] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.640168] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.640280] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.640413] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.640535] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.640712] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.640953] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.692303] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.692303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.692303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.692303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.692303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.692553] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.692553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.692553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.693094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.693094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.693094] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.693354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.693354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.693484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.693532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.693760] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.693916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.693916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.694504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.694504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.694504] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acdbba8b-e86f-40a9-8892-22733abd6f87 is going to be created. [ 658.698346] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.698760] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.058 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 658.698760] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.699071] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.699289] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.699469] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.699846] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.701385] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.701385] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d33a6a2d-6310-4263-adf4-dcf09ce72a6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.704310] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.704466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.704527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.704718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.704841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.704934] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 already deleted. [ 658.705274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.771985] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.772195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.772298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.772516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.772734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.788074] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acdbba8b-e86f-40a9-8892-22733abd6f87 in Status: IN_PROGRESS for 2s [ 659.204387] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.206511] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.206796] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.207208] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.207821] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.208518] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port d33a6a2d-6310-4263-adf4-dcf09ce72a6b not found, creating... [ 659.209076] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.209418] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.212353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.212353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.212353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.212353] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.212353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.212527] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.213094] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.213440] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.213440] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: d33a6a2d-6310-4263-adf4-dcf09ce72a6b is going to be created. [ 659.239888] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.239888] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.239888] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.239888] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.239888] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.239888] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.569476] env[61538]: INFO networking_nsxv3.common.synchronization [None req-39b63cfd-bd27-4c64-a400-059a8ea9e0cf None None] Enqueued Resource ID: 0cec144d-ef7a-4841-85fd-4100abfffac4 with Priority: HIGHEST for action port [ 659.569476] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cec144d-ef7a-4841-85fd-4100abfffac4 with Priority: HIGHEST for action port [ 659.571345] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cec144d-ef7a-4841-85fd-4100abfffac4 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.571543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cec144d-ef7a-4841-85fd-4100abfffac4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.571598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cec144d-ef7a-4841-85fd-4100abfffac4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.572178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cec144d-ef7a-4841-85fd-4100abfffac4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.572178] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cec144d-ef7a-4841-85fd-4100abfffac4',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.607588] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c5d498c2-91a1-4541-8d50-74933286df28 None None] Enqueued Resource ID: 250b59f3-961e-49a1-b781-889557f27c42 with Priority: HIGHEST for action port [ 659.611450] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250b59f3-961e-49a1-b781-889557f27c42 with Priority: HIGHEST for action port [ 659.611450] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-250b59f3-961e-49a1-b781-889557f27c42 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.611450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-250b59f3-961e-49a1-b781-889557f27c42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.611450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-250b59f3-961e-49a1-b781-889557f27c42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.611450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-250b59f3-961e-49a1-b781-889557f27c42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.611450] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('250b59f3-961e-49a1-b781-889557f27c42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.669146] env[61538]: INFO networking_nsxv3.common.synchronization [req-42f423b9-9999-4947-8ee0-e75534250289 req-f1ffbb1f-88bb-433b-bf99-cc3147f9d4af tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 659.670470] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 659.670786] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.670899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.670961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.671311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.671478] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.671583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.672883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.674127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.674127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.674257] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.732223] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11683c57-c820-44f9-8374-c60833d4038c in Status: SUCCESS [ 659.732440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.732565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.732807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.733647] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.733647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.733647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.733647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.733647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.733647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.733918] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11683c57-c820-44f9-8374-c60833d4038c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.083109] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cec144d-ef7a-4841-85fd-4100abfffac4 [ 660.083303] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.083433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.083496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.083705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.083816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.083923] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cec144d-ef7a-4841-85fd-4100abfffac4 already deleted. [ 660.084033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cec144d-ef7a-4841-85fd-4100abfffac4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.117688] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 250b59f3-961e-49a1-b781-889557f27c42 [ 660.120783] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.120783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.120783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.120783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.120783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.120783] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:250b59f3-961e-49a1-b781-889557f27c42 already deleted. [ 660.120783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-250b59f3-961e-49a1-b781-889557f27c42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.181799] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.181799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.181799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.181799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.181799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.182180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.182180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.182180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.182341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.182415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.182511] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 already deleted. [ 660.182634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.237018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11683c57-c820-44f9-8374-c60833d4038c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.237385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.237385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.237491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.237671] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.237757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.237844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.237945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.240210] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11683c57-c820-44f9-8374-c60833d4038c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.240210] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.240210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.240210] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11683c57-c820-44f9-8374-c60833d4038c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.528764] env[61538]: INFO networking_nsxv3.common.synchronization [req-eacad240-efe8-4577-b004-d6e386663492 req-a73f583b-d60d-4c87-bfb9-aec8529aa55d service nova] Enqueued Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_rules [ 660.528937] env[61538]: INFO networking_nsxv3.common.synchronization [req-eacad240-efe8-4577-b004-d6e386663492 req-a73f583b-d60d-4c87-bfb9-aec8529aa55d service nova] Enqueued Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 660.529117] env[61538]: INFO networking_nsxv3.common.synchronization [req-eacad240-efe8-4577-b004-d6e386663492 req-a73f583b-d60d-4c87-bfb9-aec8529aa55d service nova] Enqueued Resource ID: d33a6a2d-6310-4263-adf4-dcf09ce72a6b with Priority: HIGHEST for action port [ 660.529635] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_rules [ 660.529775] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 660.529873] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d33a6a2d-6310-4263-adf4-dcf09ce72a6b with Priority: HIGHEST for action port [ 660.530401] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.530530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.530596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.531118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.531118] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.531761] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.531906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.531936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.532308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.532308] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.532434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.532434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.532596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.532596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.532721] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.533410] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.533556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.533637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.533745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.533775] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d33a6a2d-6310-4263-adf4-dcf09ce72a6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.613567] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.615248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.615248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.615248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.615894] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.616344] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.619032] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.619032] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.619032] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.619032] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.619032] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.619032] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.619032] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.619032] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.619032] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.619032] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.658593] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.658593] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.658593] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.658593] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.658593] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.658593] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.658593] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.658593] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.658593] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.744686] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11683c57-c820-44f9-8374-c60833d4038c: rpc.has_security_group_logging(os_id): False [ 660.763152] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.765042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.765042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.765042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.765042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.765042] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.765042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.765042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.765042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.765042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.766284] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.770018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.770018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.770018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.770018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.770018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.770018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.770018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.770018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.770018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.770018] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11683c57-c820-44f9-8374-c60833d4038c is going to be created. [ 660.803677] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acdbba8b-e86f-40a9-8892-22733abd6f87 in Status: SUCCESS [ 660.803677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.840429] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.840429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.840429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.840698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.840755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.853327] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11683c57-c820-44f9-8374-c60833d4038c in Status: IN_PROGRESS for 2s [ 661.042329] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.043528] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.043641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.043987] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d33a6a2d-6310-4263-adf4-dcf09ce72a6b with status ACTIVE [ 661.044236] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.044372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.044451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.044694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.044823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.045057] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.045177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.045251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.045418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.046593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.046593] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.046593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.046593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.046593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.046593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.046593] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d33a6a2d-6310-4263-adf4-dcf09ce72a6b is going to be updated. [ 661.078174] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.078310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.078357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.078542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.079293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.079456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d33a6a2d-6310-4263-adf4-dcf09ce72a6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.161837] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.162772] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.162772] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.163987] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.163987] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.165468] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6 not found, creating... [ 661.165468] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.165468] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.165468] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.166191] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.166664] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.169636] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.169636] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.169636] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.169636] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.169636] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.169636] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6 is going to be created. [ 661.209659] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.210549] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.211225] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.211225] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.211364] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.211522] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.215437] env[61538]: INFO networking_nsxv3.common.synchronization [None req-08b62e80-bce4-4e5a-b173-23beefc88ccd tempest-ServersWithSpecificFlavorTestJSON-1598309329 tempest-ServersWithSpecificFlavorTestJSON-1598309329-project-member] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_rules [ 661.216827] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_rules [ 661.217387] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.217904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.217904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.220931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.220931] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.433070] env[61538]: INFO networking_nsxv3.common.synchronization [None req-2dbfdd1e-5e4b-4566-8f54-68ec017ebb4a tempest-ServersWithSpecificFlavorTestJSON-1598309329 tempest-ServersWithSpecificFlavorTestJSON-1598309329-project-member] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_rules [ 661.433070] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_rules [ 661.433070] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.433070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.548993] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.748426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.748426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.748426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.748426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.748426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.748426] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e already deleted. [ 661.748426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.748426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.749064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.749064] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.054102] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.054102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.054102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.054102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.054102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.054102] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 580370e7-ea25-4027-912b-de772679071c is going to be created. [ 662.083986] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.084147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.084325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.084487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.084656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.096519] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: UNINITIALIZED for 2s [ 662.275055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.275055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.275055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.275055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.275055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.275055] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e already deleted. [ 662.275529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.453195] env[61538]: INFO networking_nsxv3.common.synchronization [req-42f423b9-9999-4947-8ee0-e75534250289 req-a35ab7ef-fba2-4022-b7f0-794ec37cac52 service nova] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 662.453195] env[61538]: INFO networking_nsxv3.common.synchronization [req-42f423b9-9999-4947-8ee0-e75534250289 req-a35ab7ef-fba2-4022-b7f0-794ec37cac52 service nova] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 662.453195] env[61538]: INFO networking_nsxv3.common.synchronization [req-42f423b9-9999-4947-8ee0-e75534250289 req-a35ab7ef-fba2-4022-b7f0-794ec37cac52 service nova] Enqueued Resource ID: a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6 with Priority: HIGHEST for action port [ 662.453195] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 662.455235] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 662.458941] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6 with Priority: HIGHEST for action port [ 662.458941] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.458941] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.458941] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.458941] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.458941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.458941] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.466894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.466894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.466894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.466894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.466894] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.869062] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11683c57-c820-44f9-8374-c60833d4038c in Status: SUCCESS [ 662.869427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.967206] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.967489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.967636] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.968709] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6 with status ACTIVE [ 662.969058] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.969058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.969262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.969322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.969369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.969579] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.970353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.970353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.970353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.970353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.971294] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.971426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.971474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.971923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.972026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.972119] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6 is going to be updated. [ 662.993674] env[61538]: INFO networking_nsxv3.common.synchronization [None req-ed041499-d392-4f35-9d42-fa5ed7760295 None None] Enqueued Resource ID: dda70867-6b85-46bb-9608-0cfd2d8ea84e with Priority: HIGHEST for action port [ 662.994197] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda70867-6b85-46bb-9608-0cfd2d8ea84e with Priority: HIGHEST for action port [ 662.995319] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-dda70867-6b85-46bb-9608-0cfd2d8ea84e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.995319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dda70867-6b85-46bb-9608-0cfd2d8ea84e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.995319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dda70867-6b85-46bb-9608-0cfd2d8ea84e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.995319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dda70867-6b85-46bb-9608-0cfd2d8ea84e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.996647] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda70867-6b85-46bb-9608-0cfd2d8ea84e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.002329] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.002329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.002329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.002329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.002329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.002329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2f62a8a-fffb-45a0-9cc8-4b9bb01c8fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.434015] env[61538]: INFO networking_nsxv3.common.synchronization [None req-e7d574e4-762f-457a-8099-4c5ab61e4ae3 None None] Enqueued Resource ID: 1a52e0a8-6241-45c7-92da-afbdbf51fe47 with Priority: HIGHEST for action port [ 663.437675] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a52e0a8-6241-45c7-92da-afbdbf51fe47 with Priority: HIGHEST for action port [ 663.439452] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a52e0a8-6241-45c7-92da-afbdbf51fe47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.442053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a52e0a8-6241-45c7-92da-afbdbf51fe47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.442133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a52e0a8-6241-45c7-92da-afbdbf51fe47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.442403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a52e0a8-6241-45c7-92da-afbdbf51fe47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.442482] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a52e0a8-6241-45c7-92da-afbdbf51fe47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.475024] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.501246] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dda70867-6b85-46bb-9608-0cfd2d8ea84e [ 663.501475] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.501602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.501667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.501876] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.501969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.502073] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dda70867-6b85-46bb-9608-0cfd2d8ea84e already deleted. [ 663.503082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dda70867-6b85-46bb-9608-0cfd2d8ea84e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.945655] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a52e0a8-6241-45c7-92da-afbdbf51fe47 [ 663.946024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.946211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.946286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.946443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.946539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.946635] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a52e0a8-6241-45c7-92da-afbdbf51fe47 already deleted. [ 663.946760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a52e0a8-6241-45c7-92da-afbdbf51fe47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.978088] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.978571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.978750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.978988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.979277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.979277] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be created. [ 664.007792] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.007951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.007993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.008222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.008397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.019611] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: UNINITIALIZED for 2s [ 664.111268] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: SUCCESS [ 664.111268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.111268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.111268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.111268] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.111268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.111268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.111268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.111268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.111268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.111268] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.615153] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.615550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.615939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.616340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.616567] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.616691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.616752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.616994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.617143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.617232] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.617395] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.617515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.617577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.617751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.618012] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.618109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.618168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.618321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.618411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.618509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.618586] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.122032] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 580370e7-ea25-4027-912b-de772679071c: rpc.has_security_group_logging(os_id): False [ 665.148324] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.148324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.148324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.148324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.148324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.148324] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.148562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.148562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.148924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.149016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.149247] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.149344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.149404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.149710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.150015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.150263] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.150365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.150427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.150570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.150643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.150741] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 580370e7-ea25-4027-912b-de772679071c is going to be created. [ 665.217478] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.217683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.217683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.217918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.218133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.237223] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 580370e7-ea25-4027-912b-de772679071c in Status: IN_PROGRESS for 2s [ 666.033579] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 666.038096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.038096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.038096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.038096] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.038096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.038096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.038096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.038096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.038096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.038096] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.067518] env[61538]: INFO networking_nsxv3.common.synchronization [None req-0107c03e-e893-4261-90fd-ca47b7288026 None None] Enqueued Resource ID: ae3f31dc-801d-4219-9cf2-78b47f1a1e5a with Priority: HIGHEST for action port [ 666.069804] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3f31dc-801d-4219-9cf2-78b47f1a1e5a with Priority: HIGHEST for action port [ 666.070480] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae3f31dc-801d-4219-9cf2-78b47f1a1e5a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.070779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae3f31dc-801d-4219-9cf2-78b47f1a1e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.070986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae3f31dc-801d-4219-9cf2-78b47f1a1e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.072706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae3f31dc-801d-4219-9cf2-78b47f1a1e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.072706] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae3f31dc-801d-4219-9cf2-78b47f1a1e5a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.541862] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.574930] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae3f31dc-801d-4219-9cf2-78b47f1a1e5a [ 666.575210] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.575340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.575411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.575619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.575715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.575810] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae3f31dc-801d-4219-9cf2-78b47f1a1e5a already deleted. [ 666.575894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae3f31dc-801d-4219-9cf2-78b47f1a1e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.045398] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 550dcd2b-7021-4904-a80d-13c93ea25fe6: rpc.has_security_group_logging(os_id): False [ 667.066230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.066385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.066454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.066640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.067046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.067046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.067281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.067281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.067281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.067635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.067635] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be created. [ 667.143440] env[61538]: INFO networking_nsxv3.common.synchronization [req-7ce3d1c1-33e7-4bd9-a304-5ad003a0e32a req-31d87a4c-100c-4e78-8393-b4db4d9defb1 tempest-DeleteServersAdminTestJSON-446284206 tempest-DeleteServersAdminTestJSON-446284206-project-admin] Enqueued Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 667.145289] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.145597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.145769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.146136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.146442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.147951] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 667.148393] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.148613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.148769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.149078] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.149341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.150788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.150788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.150788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.150788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.150788] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.165441] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: IN_PROGRESS for 2s [ 667.269511] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 580370e7-ea25-4027-912b-de772679071c in Status: SUCCESS [ 667.269511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.652763] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.653259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.653395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.653707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.653821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.654074] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.654249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.654324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.654636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.654636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.654737] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d is going to be updated. [ 667.716187] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.716187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.716187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.716187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.716187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.726622] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: IN_PROGRESS for 2s [ 668.927164] env[61538]: INFO networking_nsxv3.common.synchronization [req-9468e292-c285-4306-96f5-d8ad2febb656 req-e9fae437-a994-4655-9e03-2c8a1983bfba tempest-InstanceActionsTestJSON-1766073935 tempest-InstanceActionsTestJSON-1766073935-project-member] Enqueued Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGHEST for action security_group_members [ 668.927164] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGHEST for action security_group_members [ 668.927164] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc67a55-ecea-4935-9926-a0733e53d126 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.927750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.927750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.928312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.928560] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.928627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.928661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.928804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.928922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.929037] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc67a55-ecea-4935-9926-a0733e53d126',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.181395] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 669.181690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.431620] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.431834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.431911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.432164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.432266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.432474] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.432575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.432664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.432827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.432926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.433029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc67a55-ecea-4935-9926-a0733e53d126 already deleted. [ 669.433135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.484059] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.484294] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-162" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.484423] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-162" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.484759] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-162" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.485293] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.485553] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.485677] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.486108] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.486338] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.486369] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.486635] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.486800] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.487127] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.487363] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.487659] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.487869] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.508472] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.508656] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.508779] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.509519] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-162" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.509519] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-4823df3e-d5b5-411f-b835-7dddc654e899 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.509519] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-4823df3e-d5b5-411f-b835-7dddc654e899" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.509942] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-4823df3e-d5b5-411f-b835-7dddc654e899" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.509942] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-4823df3e-d5b5-411f-b835-7dddc654e899" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.510086] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4823df3e-d5b5-411f-b835-7dddc654e899',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.736879] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: SUCCESS [ 669.738412] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d deletion is rescheduled due to dependency. [ 669.738412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.016098] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.016098] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.016098] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.016098] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.016098] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.016098] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 4823df3e-d5b5-411f-b835-7dddc654e899 not found, creating... [ 670.016098] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.016098] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.018163] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.018163] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.021281] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.021281] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.021281] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.021281] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.021281] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.021281] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.021281] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 4823df3e-d5b5-411f-b835-7dddc654e899 is going to be created. [ 670.047161] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.047324] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.047355] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.047625] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.047859] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.048120] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-4823df3e-d5b5-411f-b835-7dddc654e899" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.297222] env[61538]: INFO networking_nsxv3.common.synchronization [req-3c010039-90b7-4d8d-a7ed-a7901b5b9e61 req-993dffca-a399-40c3-b905-82646ea816a7 tempest-ServerDiagnosticsNegativeTest-1080856404 tempest-ServerDiagnosticsNegativeTest-1080856404-project-member] Enqueued Resource ID: 0af22a35-c045-464f-ae65-fa54f84e116a with Priority: HIGHEST for action security_group_members [ 670.297801] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af22a35-c045-464f-ae65-fa54f84e116a with Priority: HIGHEST for action security_group_members [ 670.298143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af22a35-c045-464f-ae65-fa54f84e116a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.298823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.298823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.298823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.298823] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.298823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.299029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.299029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.299661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.299661] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af22a35-c045-464f-ae65-fa54f84e116a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.801814] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.805583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.805583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.805583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.805583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.805583] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.805583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.805583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.805583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.805583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.805583] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af22a35-c045-464f-ae65-fa54f84e116a is going to be updated. [ 670.835504] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.835504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.835504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.835504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.835504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.847686] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af22a35-c045-464f-ae65-fa54f84e116a in Status: IN_PROGRESS for 2s [ 671.482469] env[61538]: INFO networking_nsxv3.common.synchronization [req-9468e292-c285-4306-96f5-d8ad2febb656 req-30da9b70-31c0-47f8-86e3-f51130a302fd service nova] Enqueued Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGHEST for action security_group_rules [ 671.482715] env[61538]: INFO networking_nsxv3.common.synchronization [req-9468e292-c285-4306-96f5-d8ad2febb656 req-30da9b70-31c0-47f8-86e3-f51130a302fd service nova] Enqueued Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGHEST for action security_group_members [ 671.482830] env[61538]: INFO networking_nsxv3.common.synchronization [req-9468e292-c285-4306-96f5-d8ad2febb656 req-30da9b70-31c0-47f8-86e3-f51130a302fd service nova] Enqueued Resource ID: 4823df3e-d5b5-411f-b835-7dddc654e899 with Priority: HIGHEST for action port [ 671.483072] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGHEST for action security_group_rules [ 671.483205] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGHEST for action security_group_members [ 671.483301] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4823df3e-d5b5-411f-b835-7dddc654e899 with Priority: HIGHEST for action port [ 671.483921] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fc67a55-ecea-4935-9926-a0733e53d126 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.484054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.484092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.484930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.485063] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fc67a55-ecea-4935-9926-a0733e53d126',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.486084] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc67a55-ecea-4935-9926-a0733e53d126 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.490036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.490036] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc67a55-ecea-4935-9926-a0733e53d126',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.490036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-4823df3e-d5b5-411f-b835-7dddc654e899 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4823df3e-d5b5-411f-b835-7dddc654e899" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4823df3e-d5b5-411f-b835-7dddc654e899" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.490036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4823df3e-d5b5-411f-b835-7dddc654e899" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.490036] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4823df3e-d5b5-411f-b835-7dddc654e899',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.793156] env[61538]: INFO networking_nsxv3.common.synchronization [req-c06c4048-26ea-477d-9ff3-19bdc18c9600 req-6fc5323f-21df-480b-8c89-6a071cec5dd3 tempest-ServersAdminNegativeTestJSON-1477357562 tempest-ServersAdminNegativeTestJSON-1477357562-project-member] Enqueued Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 671.794242] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 671.794242] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.794242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.799139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.799503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.799716] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.803182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.804091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.804091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.804091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.804091] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.991621] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc67a55-ecea-4935-9926-a0733e53d126 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.995021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.995021] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fc67a55-ecea-4935-9926-a0733e53d126',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.995021] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4823df3e-d5b5-411f-b835-7dddc654e899 with status ACTIVE [ 671.995021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.995021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.995021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.995021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.995021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.995021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.995021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.995021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.995021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.995021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.995021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.995859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.996065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.996796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.996963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.997145] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4823df3e-d5b5-411f-b835-7dddc654e899 is going to be updated. [ 672.021509] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.021781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.021841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.022145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.022326] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.022591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4823df3e-d5b5-411f-b835-7dddc654e899" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.307085] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.307367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.307367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.307562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.307652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.307904] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.307951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.308008] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.308163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.308241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.308332] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc already deleted. [ 672.308405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.499894] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fc67a55-ecea-4935-9926-a0733e53d126',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.813128] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.813334] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.813460] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.813738] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.813999] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.814174] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.814565] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.814565] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.814682] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.814846] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 672.818022] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.818022] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.818022] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.818022] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 672.818022] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.818528] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.841818] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.841818] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 672.842991] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.843091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.844912] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.844912] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.844912] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.844912] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.844912] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e19a0a22-1c4e-4aa7-94cf-a5e630bb1857',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.858710] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af22a35-c045-464f-ae65-fa54f84e116a in Status: SUCCESS [ 672.858882] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af22a35-c045-464f-ae65-fa54f84e116a deletion is rescheduled due to dependency. [ 672.859010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af22a35-c045-464f-ae65-fa54f84e116a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.003863] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.003863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.003863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.004047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.004047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.004142] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc67a55-ecea-4935-9926-a0733e53d126 is going to be created. [ 673.035885] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.036133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.036206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.036427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.036581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.050013] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc67a55-ecea-4935-9926-a0733e53d126 in Status: UNINITIALIZED for 2s [ 673.349138] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.349380] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.349510] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.349814] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.349992] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.350143] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port e19a0a22-1c4e-4aa7-94cf-a5e630bb1857 not found, creating... [ 673.350406] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.350562] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.350679] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.350898] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.351180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.351373] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.351573] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.351711] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.351826] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.351976] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.352143] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: e19a0a22-1c4e-4aa7-94cf-a5e630bb1857 is going to be created. [ 673.375465] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.375667] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.375744] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.376068] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.376315] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.376545] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.533367] env[61538]: INFO networking_nsxv3.common.synchronization [req-6e7a0588-ce08-40d9-aa3a-c42ad94bf420 req-509aa30e-16b7-4c55-b46f-17ed38105142 tempest-ServerDiagnosticsTest-463569044 tempest-ServerDiagnosticsTest-463569044-project-member] Enqueued Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGHEST for action security_group_members [ 673.533905] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGHEST for action security_group_members [ 673.534278] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11683c57-c820-44f9-8374-c60833d4038c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.534425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.534497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.534687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.534842] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.535018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.535101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.535280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.535366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.535551] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11683c57-c820-44f9-8374-c60833d4038c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.711583] env[61538]: INFO networking_nsxv3.common.synchronization [None req-5c1e3a73-e3c7-49f1-91e7-68084ca5d0c2 None None] Enqueued Resource ID: 6976555a-9f6e-47c0-a280-db56f64941c4 with Priority: HIGHEST for action port [ 673.711870] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6976555a-9f6e-47c0-a280-db56f64941c4 with Priority: HIGHEST for action port [ 673.712739] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-6976555a-9f6e-47c0-a280-db56f64941c4 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.712937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6976555a-9f6e-47c0-a280-db56f64941c4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.712937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6976555a-9f6e-47c0-a280-db56f64941c4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.714720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6976555a-9f6e-47c0-a280-db56f64941c4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.715062] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6976555a-9f6e-47c0-a280-db56f64941c4',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.038233] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.038470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.038584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.038877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.039038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.039320] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.039496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.039620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.040166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.040166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.040166] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11683c57-c820-44f9-8374-c60833d4038c is going to be updated. [ 674.078028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.078028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.078028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.078028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.078028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.090225] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11683c57-c820-44f9-8374-c60833d4038c in Status: IN_PROGRESS for 2s [ 674.217981] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6976555a-9f6e-47c0-a280-db56f64941c4 [ 674.218248] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.218456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.218456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.218733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.218907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.218997] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6976555a-9f6e-47c0-a280-db56f64941c4 already deleted. [ 674.219142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6976555a-9f6e-47c0-a280-db56f64941c4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.067786] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc67a55-ecea-4935-9926-a0733e53d126 in Status: SUCCESS [ 675.067786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.067786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.067786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.068159] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.068159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.068159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.068475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.068475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.068475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.068623] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fc67a55-ecea-4935-9926-a0733e53d126',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.399227] env[61538]: INFO networking_nsxv3.common.synchronization [req-c06c4048-26ea-477d-9ff3-19bdc18c9600 req-1659d4c6-7724-453c-a684-ca403e8273f1 service nova] Enqueued Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_rules [ 675.399456] env[61538]: INFO networking_nsxv3.common.synchronization [req-c06c4048-26ea-477d-9ff3-19bdc18c9600 req-1659d4c6-7724-453c-a684-ca403e8273f1 service nova] Enqueued Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 675.399650] env[61538]: INFO networking_nsxv3.common.synchronization [req-c06c4048-26ea-477d-9ff3-19bdc18c9600 req-1659d4c6-7724-453c-a684-ca403e8273f1 service nova] Enqueued Resource ID: e19a0a22-1c4e-4aa7-94cf-a5e630bb1857 with Priority: HIGHEST for action port [ 675.400329] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_rules [ 675.400683] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 675.400809] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e19a0a22-1c4e-4aa7-94cf-a5e630bb1857 with Priority: HIGHEST for action port [ 675.401417] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.401577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.401649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.401920] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.402019] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.402867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.403014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.403111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.403323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.403433] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.404008] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.404125] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.404293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.404389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.405237] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.406082] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.406254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.406254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.406565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.406565] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e19a0a22-1c4e-4aa7-94cf-a5e630bb1857',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.573794] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc67a55-ecea-4935-9926-a0733e53d126 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.573946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.573994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.574257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.574471] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.574582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.574646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.575851] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc67a55-ecea-4935-9926-a0733e53d126 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.575851] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.575851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.576325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.576325] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fc67a55-ecea-4935-9926-a0733e53d126',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.657023] env[61538]: INFO networking_nsxv3.common.synchronization [None req-0a47a178-1cb9-4018-a6bf-e4f52d4ca1be None None] Enqueued Resource ID: ea6cc70b-bdfe-426a-96ce-b836b5d1519c with Priority: HIGHEST for action port [ 675.657023] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea6cc70b-bdfe-426a-96ce-b836b5d1519c with Priority: HIGHEST for action port [ 675.657023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea6cc70b-bdfe-426a-96ce-b836b5d1519c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.657023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea6cc70b-bdfe-426a-96ce-b836b5d1519c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.657023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea6cc70b-bdfe-426a-96ce-b836b5d1519c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.657023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea6cc70b-bdfe-426a-96ce-b836b5d1519c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.657023] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea6cc70b-bdfe-426a-96ce-b836b5d1519c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.908395] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.908550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.908657] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.912489] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e19a0a22-1c4e-4aa7-94cf-a5e630bb1857 with status ACTIVE [ 675.912489] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.912489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.912489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.912489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.912489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.912489] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.912489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.912489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.913065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.913065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.913523] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.913602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.913846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.913846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.915231] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.915343] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e19a0a22-1c4e-4aa7-94cf-a5e630bb1857 is going to be updated. [ 675.943403] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.943586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.943660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.943890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.944532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.944532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e19a0a22-1c4e-4aa7-94cf-a5e630bb1857" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.085093] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fc67a55-ecea-4935-9926-a0733e53d126: rpc.has_security_group_logging(os_id): False [ 676.109029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11683c57-c820-44f9-8374-c60833d4038c in Status: SUCCESS [ 676.109239] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11683c57-c820-44f9-8374-c60833d4038c deletion is rescheduled due to dependency. [ 676.109372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.121230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.121230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.121230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.121230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.122262] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.122262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.122262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.122262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.122262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.122262] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fc67a55-ecea-4935-9926-a0733e53d126 is going to be created. [ 676.159426] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea6cc70b-bdfe-426a-96ce-b836b5d1519c [ 676.159718] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.159835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.159879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.160646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.160744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.160783] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea6cc70b-bdfe-426a-96ce-b836b5d1519c already deleted. [ 676.160867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea6cc70b-bdfe-426a-96ce-b836b5d1519c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.222487] env[61538]: INFO networking_nsxv3.common.synchronization [req-4f5f0886-86d0-4e7c-a954-8371c8142684 req-dcaf5932-6804-4557-bfec-4f1377e2bd31 tempest-TenantUsagesTestJSON-197157338 tempest-TenantUsagesTestJSON-197157338-project-member] Enqueued Resource ID: acdbba8b-e86f-40a9-8892-22733abd6f87 with Priority: HIGHEST for action security_group_members [ 676.222487] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdbba8b-e86f-40a9-8892-22733abd6f87 with Priority: HIGHEST for action security_group_members [ 676.224186] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbba8b-e86f-40a9-8892-22733abd6f87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.224314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.224380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.224595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.224761] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.224865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.224950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.225217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.225380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.225494] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acdbba8b-e86f-40a9-8892-22733abd6f87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.228254] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.228390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.228459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.228633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.228815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.244119] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fc67a55-ecea-4935-9926-a0733e53d126 in Status: IN_PROGRESS for 2s [ 676.412151] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.732060] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.732256] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.732312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.732549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.732652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.732865] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.733176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.733176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.733371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.733478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.733574] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acdbba8b-e86f-40a9-8892-22733abd6f87 is going to be updated. [ 676.765149] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.766795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.766933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.767235] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.767386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.781181] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acdbba8b-e86f-40a9-8892-22733abd6f87 in Status: IN_PROGRESS for 2s [ 676.913780] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.913929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.913993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.914788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.914788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.914788] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc is going to be created. [ 676.943142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.943142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.943142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.943142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.943142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.954766] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: UNINITIALIZED for 2s [ 677.104575] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c35c341a-271e-475c-be2e-231ba791ee30 None None] Enqueued Resource ID: 3da43e74-8cf7-4f4e-af0f-653347a3dba7 with Priority: HIGHEST for action port [ 677.104854] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3da43e74-8cf7-4f4e-af0f-653347a3dba7 with Priority: HIGHEST for action port [ 677.106521] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-3da43e74-8cf7-4f4e-af0f-653347a3dba7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.106521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3da43e74-8cf7-4f4e-af0f-653347a3dba7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.106521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3da43e74-8cf7-4f4e-af0f-653347a3dba7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.106521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3da43e74-8cf7-4f4e-af0f-653347a3dba7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.106521] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3da43e74-8cf7-4f4e-af0f-653347a3dba7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.188176] env[61538]: INFO networking_nsxv3.common.synchronization [req-56a55048-04dd-46c7-8874-35b0c6c040ef req-a8ff49ac-1c20-4fb5-acec-9576a772ace7 tempest-VolumesAssistedSnapshotsTest-760021604 tempest-VolumesAssistedSnapshotsTest-760021604-project-member] Enqueued Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_members [ 677.189023] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_members [ 677.189594] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.189750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.189838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.190354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.190548] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.191410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.191410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.191947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.191947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.191947] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.610013] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3da43e74-8cf7-4f4e-af0f-653347a3dba7 [ 677.610291] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.610541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.610616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.610925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.611863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.611863] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3da43e74-8cf7-4f4e-af0f-653347a3dba7 already deleted. [ 677.611863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3da43e74-8cf7-4f4e-af0f-653347a3dba7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.694772] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.694772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.695185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.695277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.695436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.695684] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.695855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.696046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.706080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.706080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.706080] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff already deleted. [ 677.706080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.961217] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.961332] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-224" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.961430] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-224" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.961766] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-224" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.962094] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.962271] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.962339] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.963367] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.963524] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.963812] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.963861] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.963969] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.964087] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.964202] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.964302] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.964436] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.996989] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.997247] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 677.997360] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.997549] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-224" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.998731] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-400a0ea3-0087-4d35-bc44-2849c40231e6 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.998731] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-400a0ea3-0087-4d35-bc44-2849c40231e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.998731] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-400a0ea3-0087-4d35-bc44-2849c40231e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.998731] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-400a0ea3-0087-4d35-bc44-2849c40231e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.998731] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('400a0ea3-0087-4d35-bc44-2849c40231e6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.259137] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fc67a55-ecea-4935-9926-a0733e53d126 in Status: SUCCESS [ 678.259137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.498786] env[61538]: INFO networking_nsxv3.common.synchronization [None req-830cdd14-f480-4985-b590-23e4bab1c330 None None] Enqueued Resource ID: eab02a1c-68df-40e8-bb70-32f1304c2167 with Priority: HIGHEST for action port [ 678.499447] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab02a1c-68df-40e8-bb70-32f1304c2167 with Priority: HIGHEST for action port [ 678.499842] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-eab02a1c-68df-40e8-bb70-32f1304c2167 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.499988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eab02a1c-68df-40e8-bb70-32f1304c2167" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.500204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eab02a1c-68df-40e8-bb70-32f1304c2167" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.500491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eab02a1c-68df-40e8-bb70-32f1304c2167" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.500635] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eab02a1c-68df-40e8-bb70-32f1304c2167',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.501798] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.502103] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.502341] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.502626] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.503541] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.503637] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 400a0ea3-0087-4d35-bc44-2849c40231e6 not found, creating... [ 678.504673] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.504673] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.504673] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.504673] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.504673] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.505371] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.505434] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.510194] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.510194] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.510194] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.510194] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 400a0ea3-0087-4d35-bc44-2849c40231e6 is going to be created. [ 678.540278] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.540571] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.540730] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.541093] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.541379] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.541654] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-400a0ea3-0087-4d35-bc44-2849c40231e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.795157] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acdbba8b-e86f-40a9-8892-22733abd6f87 in Status: SUCCESS [ 678.795157] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acdbba8b-e86f-40a9-8892-22733abd6f87 deletion is rescheduled due to dependency. [ 678.795157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbba8b-e86f-40a9-8892-22733abd6f87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.968834] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: SUCCESS [ 678.968834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.969569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.969569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.969994] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.969994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.969994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.970251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.970251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.970422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.970422] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.014174] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eab02a1c-68df-40e8-bb70-32f1304c2167 [ 679.014521] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.014686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.014776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.015023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.015120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.015241] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eab02a1c-68df-40e8-bb70-32f1304c2167 already deleted. [ 679.015335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eab02a1c-68df-40e8-bb70-32f1304c2167" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.308757] env[61538]: INFO networking_nsxv3.common.synchronization [req-6703c4a9-a33a-4fe7-a1f0-0e290b8b5913 req-6536a77e-8f33-4f17-b7bc-9a31b250eed8 tempest-InstanceActionsV221TestJSON-1438125054 tempest-InstanceActionsV221TestJSON-1438125054-project-member] Enqueued Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGHEST for action security_group_members [ 679.309195] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGHEST for action security_group_members [ 679.310564] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.313782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.313782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.313782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.313782] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.313782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.313782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.313782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.313782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.315270] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea2928f0-ca1a-4287-ba3e-ef5db6d0b393',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.473506] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.473705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.477519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.477519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.477519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.477519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.477519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.477519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.477519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.477519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.477519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.477519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.477519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.479617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.479617] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.479617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.479617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.479617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.479617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.479617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.479617] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.817377] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.817994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.817994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.817994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.820551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.820943] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.820943] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.821111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.821563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.821563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.821563] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 already deleted. [ 679.821563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.836970] env[61538]: INFO networking_nsxv3.common.synchronization [None req-da48be74-5762-46ae-b9e4-5dd8c62f0f28 None None] Enqueued Resource ID: cf75f6e3-1e98-49a6-9723-5df98b7b0cce with Priority: HIGHEST for action port [ 679.837538] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf75f6e3-1e98-49a6-9723-5df98b7b0cce with Priority: HIGHEST for action port [ 679.838952] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf75f6e3-1e98-49a6-9723-5df98b7b0cce taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.840380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf75f6e3-1e98-49a6-9723-5df98b7b0cce" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.840509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf75f6e3-1e98-49a6-9723-5df98b7b0cce" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.840864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf75f6e3-1e98-49a6-9723-5df98b7b0cce" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.840981] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf75f6e3-1e98-49a6-9723-5df98b7b0cce',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.982251] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9f9cc04-e7d3-4a55-ba09-c74518d114dc: rpc.has_security_group_logging(os_id): False [ 680.006150] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.006324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.006395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.010639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.010801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.011039] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.011159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.011244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.011424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.011499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.011748] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.011836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.011898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.018309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.018954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.018954] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.018954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.018954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.019342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.019518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.019628] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc is going to be created. [ 680.099377] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.099594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.099779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.099978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.100876] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.117309] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: IN_PROGRESS for 2s [ 680.343989] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf75f6e3-1e98-49a6-9723-5df98b7b0cce [ 680.344325] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.345337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.345337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.345337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.345599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.345599] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf75f6e3-1e98-49a6-9723-5df98b7b0cce already deleted. [ 680.345599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf75f6e3-1e98-49a6-9723-5df98b7b0cce" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.421565] env[61538]: INFO networking_nsxv3.common.synchronization [req-56a55048-04dd-46c7-8874-35b0c6c040ef req-b0935d31-f06e-4fad-8836-d793827e83bb service nova] Enqueued Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_rules [ 680.421565] env[61538]: INFO networking_nsxv3.common.synchronization [req-56a55048-04dd-46c7-8874-35b0c6c040ef req-b0935d31-f06e-4fad-8836-d793827e83bb service nova] Enqueued Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_members [ 680.421565] env[61538]: INFO networking_nsxv3.common.synchronization [req-56a55048-04dd-46c7-8874-35b0c6c040ef req-b0935d31-f06e-4fad-8836-d793827e83bb service nova] Enqueued Resource ID: 400a0ea3-0087-4d35-bc44-2849c40231e6 with Priority: HIGHEST for action port [ 680.421565] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_rules [ 680.421565] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_members [ 680.421565] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400a0ea3-0087-4d35-bc44-2849c40231e6 with Priority: HIGHEST for action port [ 680.422379] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.422379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.422379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.422379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.422379] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.423243] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.423348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.423412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.423573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.423901] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.424043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.424076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.424221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.424303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.424387] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.425187] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-400a0ea3-0087-4d35-bc44-2849c40231e6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.425301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-400a0ea3-0087-4d35-bc44-2849c40231e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.425364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-400a0ea3-0087-4d35-bc44-2849c40231e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.425629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-400a0ea3-0087-4d35-bc44-2849c40231e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.425629] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('400a0ea3-0087-4d35-bc44-2849c40231e6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.703786] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.704050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-939" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.704287] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-939" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.704647] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-939" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.706274] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.706274] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.706274] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.706274] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.706274] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.706556] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.706939] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.706939] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.706939] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.707099] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.707099] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.707817] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.729751] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.730674] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.731160] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.732606] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-939" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.732606] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.732606] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.732606] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.732606] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.732606] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c39c356-8b63-44c6-9bcf-46f4765b0c4b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.927267] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.927476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.932063] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 400a0ea3-0087-4d35-bc44-2849c40231e6 with status ACTIVE [ 680.932393] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.932393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.932533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.932850] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.932850] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.932982] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.933096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.933180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.933367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.933444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.933641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.933736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.933796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.933952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.934035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.934121] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 400a0ea3-0087-4d35-bc44-2849c40231e6 is going to be updated. [ 680.938541] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.964099] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.964099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.964099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.964273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.964814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.964814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-400a0ea3-0087-4d35-bc44-2849c40231e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.021109] env[61538]: INFO networking_nsxv3.common.synchronization [req-c878224f-c699-4fd0-bf7c-7c7fa8662205 req-6b293abd-94a8-4282-a935-2b9f38945651 tempest-FloatingIPsAssociationTestJSON-741219197 tempest-FloatingIPsAssociationTestJSON-741219197-project-member] Enqueued Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 681.021109] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 681.021109] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.021109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.021109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.021109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.021109] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.021109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.021109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.021718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.021822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.021925] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.195176] env[61538]: INFO networking_nsxv3.common.synchronization [None req-4e31cb84-3b0c-470b-8d05-f62829aa49ca None None] Enqueued Resource ID: 30f4e0fb-030d-43a7-90f1-83dc42d11107 with Priority: HIGHEST for action port [ 681.195176] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f4e0fb-030d-43a7-90f1-83dc42d11107 with Priority: HIGHEST for action port [ 681.195653] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-30f4e0fb-030d-43a7-90f1-83dc42d11107 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.195854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30f4e0fb-030d-43a7-90f1-83dc42d11107" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.195854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30f4e0fb-030d-43a7-90f1-83dc42d11107" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.197348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30f4e0fb-030d-43a7-90f1-83dc42d11107" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.197441] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30f4e0fb-030d-43a7-90f1-83dc42d11107',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.236813] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.237176] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.237354] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.237554] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.237715] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.237916] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 2c39c356-8b63-44c6-9bcf-46f4765b0c4b not found, creating... [ 681.238231] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.238415] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.238532] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.238810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.238955] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.239309] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.239484] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.239600] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.239834] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.239982] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.240925] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 2c39c356-8b63-44c6-9bcf-46f4765b0c4b is going to be created. [ 681.266452] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.266791] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.266791] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.267402] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.268292] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.269302] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.441168] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.503029] env[61538]: INFO networking_nsxv3.common.synchronization [None req-0f58bb7e-f2e4-4c03-9ed0-e8bed589a264 None None] Enqueued Resource ID: 3b2fc895-7fda-4073-a38a-ff8298ef1384 with Priority: HIGHEST for action port [ 681.503029] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b2fc895-7fda-4073-a38a-ff8298ef1384 with Priority: HIGHEST for action port [ 681.503029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b2fc895-7fda-4073-a38a-ff8298ef1384 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.503029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b2fc895-7fda-4073-a38a-ff8298ef1384" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.503029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b2fc895-7fda-4073-a38a-ff8298ef1384" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.505527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b2fc895-7fda-4073-a38a-ff8298ef1384" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.506266] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b2fc895-7fda-4073-a38a-ff8298ef1384',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.528475] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.528475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.528475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.528475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.528475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.528475] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.528475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.528475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.528475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.528475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.528475] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad already deleted. [ 681.528475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.702063] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30f4e0fb-030d-43a7-90f1-83dc42d11107 [ 681.702063] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.702063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.702063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.702063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.702063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.702063] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30f4e0fb-030d-43a7-90f1-83dc42d11107 already deleted. [ 681.702063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30f4e0fb-030d-43a7-90f1-83dc42d11107" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.951025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.951025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.951025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.951025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.951025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.951025] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff is going to be created. [ 681.974877] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.975116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.975171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.978342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.978342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.986889] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff in Status: UNINITIALIZED for 2s [ 682.011104] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b2fc895-7fda-4073-a38a-ff8298ef1384 [ 682.011104] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.011104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.011104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.011282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.011282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.015022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b2fc895-7fda-4073-a38a-ff8298ef1384 already deleted. [ 682.015022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b2fc895-7fda-4073-a38a-ff8298ef1384" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.134411] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: SUCCESS [ 682.134411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.173851] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.174810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-733" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.174810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-733" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.175177] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-733" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.175527] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.175527] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.175676] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.175895] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.176067] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.176287] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.176403] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.176516] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.176651] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.177117] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.177117] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.177117] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.203148] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.203312] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.203528] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.203627] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-733" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.203965] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.204155] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.204708] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.204708] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.204708] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.708901] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.709300] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.709300] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.709571] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.709761] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.710260] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e not found, creating... [ 682.710354] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.710488] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.710581] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.710803] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.710940] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.711313] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.711490] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.711609] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.711839] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.711982] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.712145] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e is going to be created. [ 682.748473] env[61538]: INFO networking_nsxv3.common.synchronization [req-6703c4a9-a33a-4fe7-a1f0-0e290b8b5913 req-83497b00-0135-4f70-8008-12eb5f6950d1 service nova] Enqueued Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGHEST for action security_group_rules [ 682.748542] env[61538]: INFO networking_nsxv3.common.synchronization [req-6703c4a9-a33a-4fe7-a1f0-0e290b8b5913 req-83497b00-0135-4f70-8008-12eb5f6950d1 service nova] Enqueued Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGHEST for action security_group_members [ 682.748913] env[61538]: INFO networking_nsxv3.common.synchronization [req-6703c4a9-a33a-4fe7-a1f0-0e290b8b5913 req-83497b00-0135-4f70-8008-12eb5f6950d1 service nova] Enqueued Resource ID: 2c39c356-8b63-44c6-9bcf-46f4765b0c4b with Priority: HIGHEST for action port [ 682.750686] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGHEST for action security_group_rules [ 682.750686] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGHEST for action security_group_members [ 682.750686] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c39c356-8b63-44c6-9bcf-46f4765b0c4b with Priority: HIGHEST for action port [ 682.750686] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.750686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.750972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.753677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.753677] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea2928f0-ca1a-4287-ba3e-ef5db6d0b393',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.753677] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.753677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.753677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.753677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.753677] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.753677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.753677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.753677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.753677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.753677] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea2928f0-ca1a-4287-ba3e-ef5db6d0b393',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.754869] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.754869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.754869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.754869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.754869] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c39c356-8b63-44c6-9bcf-46f4765b0c4b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.758581] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.759454] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.759670] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.759950] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.760232] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.760900] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.258080] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea2928f0-ca1a-4287-ba3e-ef5db6d0b393',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.260126] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.260406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.266024] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c39c356-8b63-44c6-9bcf-46f4765b0c4b with status ACTIVE [ 683.266024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.266024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.266024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.266024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.266024] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c39c356-8b63-44c6-9bcf-46f4765b0c4b is going to be updated. [ 683.289779] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.290226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.290396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.291102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.291102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.291102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c39c356-8b63-44c6-9bcf-46f4765b0c4b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.381825] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1f23f70e-2f6b-4513-9126-fb9f74ff2fce None None] Enqueued Resource ID: 1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9 with Priority: HIGHEST for action port [ 683.381825] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9 with Priority: HIGHEST for action port [ 683.381825] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.381825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.381825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.381825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.381825] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.450888] env[61538]: INFO networking_nsxv3.common.synchronization [None req-f03cf907-81ad-4bf7-9100-f3b07d5234f3 None None] Enqueued Resource ID: b9d4b3d7-5876-4a6b-a955-5959393be8db with Priority: HIGHEST for action port [ 683.451415] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d4b3d7-5876-4a6b-a955-5959393be8db with Priority: HIGHEST for action port [ 683.451783] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9d4b3d7-5876-4a6b-a955-5959393be8db taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.451913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9d4b3d7-5876-4a6b-a955-5959393be8db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.452022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9d4b3d7-5876-4a6b-a955-5959393be8db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.452537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9d4b3d7-5876-4a6b-a955-5959393be8db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.453115] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d4b3d7-5876-4a6b-a955-5959393be8db',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.763025] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea2928f0-ca1a-4287-ba3e-ef5db6d0b393',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.888410] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9 [ 683.888676] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.888813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.888937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.890041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.890041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.890041] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9 already deleted. [ 683.890041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d2a337b-a7c5-49d5-ae8f-98fa820c9fa9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.956561] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9d4b3d7-5876-4a6b-a955-5959393be8db [ 683.956561] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.956561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.956561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.956861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.956861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.956861] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9d4b3d7-5876-4a6b-a955-5959393be8db already deleted. [ 683.956969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9d4b3d7-5876-4a6b-a955-5959393be8db" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.001973] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff in Status: SUCCESS [ 684.001973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.001973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.001973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.001973] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.001973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.001973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.001973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.001973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.001973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.001973] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.255527] env[61538]: INFO networking_nsxv3.common.synchronization [None req-4f490e13-efbd-4894-bea2-fba65a1f3cb8 tempest-ServerActionsV293TestJSON-1352632226 tempest-ServerActionsV293TestJSON-1352632226-project-member] Enqueued Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_rules [ 684.256963] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_rules [ 684.256963] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365fd2af-187a-43da-9017-8bc6e06e1910 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.256963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.256963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.257482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.257608] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.264440] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.264570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.264570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.265651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.265651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.265651] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 is going to be created. [ 684.293912] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.294736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.294736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.294736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.295310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.310862] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 in Status: UNINITIALIZED for 2s [ 684.507519] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.513272] env[61538]: INFO networking_nsxv3.common.synchronization [None req-9eafedba-2ec9-4aa0-b301-ec67bfa73235 tempest-ServerActionsV293TestJSON-1352632226 tempest-ServerActionsV293TestJSON-1352632226-project-member] Enqueued Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_rules [ 684.514953] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_rules [ 684.514953] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365fd2af-187a-43da-9017-8bc6e06e1910 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.514953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.718752] env[61538]: INFO networking_nsxv3.common.synchronization [req-1ad0cabc-b1eb-413b-b2c2-d53c03434c9f req-9b2f7501-874e-4fa7-80e8-6b939b160547 tempest-ServersTestFqdnHostnames-1717368552 tempest-ServersTestFqdnHostnames-1717368552-project-member] Enqueued Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_members [ 684.722696] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_members [ 684.722696] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-850cf150-e9b7-4aa9-8141-ddd003b7e560 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.722696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.722696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.722696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.723087] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.723363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.723521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.724022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.724209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.724390] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.782653] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.782956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.782956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.783844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.784048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.784227] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365fd2af-187a-43da-9017-8bc6e06e1910 already deleted. [ 684.784398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.784648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.784934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.785093] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.983633] env[61538]: INFO networking_nsxv3.common.synchronization [req-c878224f-c699-4fd0-bf7c-7c7fa8662205 req-ff46ad7e-0702-4b7f-ad44-5ef0088c2916 service nova] Enqueued Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_rules [ 684.984267] env[61538]: INFO networking_nsxv3.common.synchronization [req-c878224f-c699-4fd0-bf7c-7c7fa8662205 req-ff46ad7e-0702-4b7f-ad44-5ef0088c2916 service nova] Enqueued Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 684.984267] env[61538]: INFO networking_nsxv3.common.synchronization [req-c878224f-c699-4fd0-bf7c-7c7fa8662205 req-ff46ad7e-0702-4b7f-ad44-5ef0088c2916 service nova] Enqueued Resource ID: b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e with Priority: HIGHEST for action port [ 684.986718] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_rules [ 684.987333] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 684.987680] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e with Priority: HIGHEST for action port [ 684.988461] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.989060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.989202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.989667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.989667] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.991783] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.991851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.992068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.992447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.992790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.993023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.993092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.993312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.994106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.994106] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.994573] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.994887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.994887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.995623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.995623] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.011339] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff: rpc.has_security_group_logging(os_id): False [ 685.034616] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.034616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.034616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.034616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.034616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.035143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.035143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.035143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.035143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.035670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.035813] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff is going to be created. [ 685.115377] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.115377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.115377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.115377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.115377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.140068] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff in Status: IN_PROGRESS for 2s [ 685.229103] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.229522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.229522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.229638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.229960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.231257] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.231503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.231845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.232238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.232238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.232378] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 already deleted. [ 685.232378] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.310367] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.310526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.310629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.311761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.311761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.311761] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365fd2af-187a-43da-9017-8bc6e06e1910 already deleted. [ 685.311761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.497189] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.497429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.497747] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e with status ACTIVE [ 685.498046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.498188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.498278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.498498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.498615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.498792] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.498928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.498987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.499225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.499330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.499575] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.499696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.500031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.500031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.500031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.500536] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e is going to be updated. [ 685.502355] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.570240] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.570433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.570433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.571229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.571229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.571229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4792d3c-8f80-4dde-bfbf-fb8ca94ce86e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.930121] env[61538]: INFO networking_nsxv3.common.synchronization [None req-11bfc3bf-8353-4390-b1c6-079dbd67b52c None None] Enqueued Resource ID: 32075389-a11b-4839-ad54-73083148f4cd with Priority: HIGHEST for action port [ 685.930121] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32075389-a11b-4839-ad54-73083148f4cd with Priority: HIGHEST for action port [ 685.930121] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-32075389-a11b-4839-ad54-73083148f4cd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.930121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32075389-a11b-4839-ad54-73083148f4cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.930121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32075389-a11b-4839-ad54-73083148f4cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.930121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32075389-a11b-4839-ad54-73083148f4cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.930121] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32075389-a11b-4839-ad54-73083148f4cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.005335] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.325569] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 in Status: SUCCESS [ 686.325922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.326180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.326630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.327460] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.327460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.327460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.332524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.332524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.332524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.332524] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea2928f0-ca1a-4287-ba3e-ef5db6d0b393',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.333960] env[61538]: INFO networking_nsxv3.common.synchronization [None req-a908fab7-d5d7-4fcb-bc52-de2ff2e53806 None None] Enqueued Resource ID: e139a7d9-0b8d-4eef-ad95-da6141653a0e with Priority: HIGHEST for action port [ 686.335519] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e139a7d9-0b8d-4eef-ad95-da6141653a0e with Priority: HIGHEST for action port [ 686.335519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e139a7d9-0b8d-4eef-ad95-da6141653a0e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.337293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e139a7d9-0b8d-4eef-ad95-da6141653a0e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.337293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e139a7d9-0b8d-4eef-ad95-da6141653a0e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.337293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e139a7d9-0b8d-4eef-ad95-da6141653a0e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.337293] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e139a7d9-0b8d-4eef-ad95-da6141653a0e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.434354] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32075389-a11b-4839-ad54-73083148f4cd [ 686.434584] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.434739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.434801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.435083] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.435160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.435268] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32075389-a11b-4839-ad54-73083148f4cd already deleted. [ 686.435421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32075389-a11b-4839-ad54-73083148f4cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.509974] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.510094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.510184] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.510468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.510625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.510871] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad is going to be created. [ 686.541518] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.541773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.541773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.543861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.544018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.558626] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: UNINITIALIZED for 2s [ 686.834800] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.835085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.835085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.835792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.835792] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.835792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.835792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.836160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.836160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.836160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.836160] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.836302] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.836302] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea2928f0-ca1a-4287-ba3e-ef5db6d0b393',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.836302] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e139a7d9-0b8d-4eef-ad95-da6141653a0e [ 686.836302] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.836302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.839926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.840064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.840177] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e139a7d9-0b8d-4eef-ad95-da6141653a0e already deleted. [ 686.840286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e139a7d9-0b8d-4eef-ad95-da6141653a0e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.880623] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-46 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.880878] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.881044] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.881510] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.881836] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.881921] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.883239] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.883239] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.883436] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.883663] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.883786] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.883999] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.883999] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.884126] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.884258] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.884450] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.908730] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.908902] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.909049] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.909237] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.909570] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-4e58a211-5e27-49a0-a9b2-0cb26978fd99 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.910574] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-4e58a211-5e27-49a0-a9b2-0cb26978fd99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.910574] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-4e58a211-5e27-49a0-a9b2-0cb26978fd99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.910574] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-4e58a211-5e27-49a0-a9b2-0cb26978fd99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.910574] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e58a211-5e27-49a0-a9b2-0cb26978fd99',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.154718] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff in Status: SUCCESS [ 687.154718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.342084] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea2928f0-ca1a-4287-ba3e-ef5db6d0b393: rpc.has_security_group_logging(os_id): False [ 687.363860] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.363860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.363860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.363860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.363860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.363860] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.363860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.363860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.364185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.364185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.364340] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.364434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.364509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.364668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.364751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.364967] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.365391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.366225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.366225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.366225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.366225] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 is going to be created. [ 687.416757] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.417013] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.417867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.417867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.417867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.418795] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 4e58a211-5e27-49a0-a9b2-0cb26978fd99 not found, creating... [ 687.419202] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.419422] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.419498] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.419737] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.419877] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.420844] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.421028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.421150] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.421377] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.421525] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.421663] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 4e58a211-5e27-49a0-a9b2-0cb26978fd99 is going to be created. [ 687.427411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.427983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.428238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.428415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.428913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.441200] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 in Status: IN_PROGRESS for 2s [ 687.449572] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.449843] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.449938] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.450307] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.450583] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.450845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-4e58a211-5e27-49a0-a9b2-0cb26978fd99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.483335] env[61538]: INFO networking_nsxv3.common.synchronization [req-23ab83ea-0b63-44af-885e-c5f26269aa06 req-a38e499f-0848-4978-bee2-351ae0772339 tempest-ImagesNegativeTestJSON-1172652629 tempest-ImagesNegativeTestJSON-1172652629-project-member] Enqueued Resource ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d with Priority: HIGHEST for action security_group_members [ 687.483957] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d with Priority: HIGHEST for action security_group_members [ 687.484319] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-500d868a-59d3-4e7e-a5ec-63123eb42a2d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.484488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.484566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.484828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.485192] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.487361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.487447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.487645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.487738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.487838] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('500d868a-59d3-4e7e-a5ec-63123eb42a2d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.992553] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.992553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.992553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.992553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.992553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.992815] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.992815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.992815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.993435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.993435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.993435] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d already deleted. [ 687.993435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.570522] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: SUCCESS [ 688.570819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.571060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.571341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.571610] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.571766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.571871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.572135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.572249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.572391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.572528] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.076014] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.076161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.077076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.077076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.077076] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.077076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.077628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.077628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.077628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.077733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.078973] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.078973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.078973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.078973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.078973] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.078973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.078973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.078973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.078973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.078973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.078973] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.359171] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.359620] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-344" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.359739] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-344" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.360192] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-344" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.366048] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.366048] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.366048] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.366048] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.366048] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.366048] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.366048] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.366048] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.366048] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.366048] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.366048] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.366048] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.397989] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.398219] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 689.398418] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.398816] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-344" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.399024] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-f3a5e417-6468-4590-aa5e-e24c16364727 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.399713] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-f3a5e417-6468-4590-aa5e-e24c16364727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.399713] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-f3a5e417-6468-4590-aa5e-e24c16364727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.399912] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-f3a5e417-6468-4590-aa5e-e24c16364727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.403381] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a5e417-6468-4590-aa5e-e24c16364727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.406392] env[61538]: INFO networking_nsxv3.common.synchronization [req-1ad0cabc-b1eb-413b-b2c2-d53c03434c9f req-c20c2239-586c-4944-ac2a-209f4b1453ba service nova] Enqueued Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_rules [ 689.406392] env[61538]: INFO networking_nsxv3.common.synchronization [req-1ad0cabc-b1eb-413b-b2c2-d53c03434c9f req-c20c2239-586c-4944-ac2a-209f4b1453ba service nova] Enqueued Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_members [ 689.406392] env[61538]: INFO networking_nsxv3.common.synchronization [req-1ad0cabc-b1eb-413b-b2c2-d53c03434c9f req-c20c2239-586c-4944-ac2a-209f4b1453ba service nova] Enqueued Resource ID: 4e58a211-5e27-49a0-a9b2-0cb26978fd99 with Priority: HIGHEST for action port [ 689.406392] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_rules [ 689.406392] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_members [ 689.406985] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e58a211-5e27-49a0-a9b2-0cb26978fd99 with Priority: HIGHEST for action port [ 689.406985] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850cf150-e9b7-4aa9-8141-ddd003b7e560 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.407162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.407162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.407590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.407590] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.409133] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-850cf150-e9b7-4aa9-8141-ddd003b7e560 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.409251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.409317] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.409529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.409691] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.409799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.409852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.409999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.410113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.410223] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.413297] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e58a211-5e27-49a0-a9b2-0cb26978fd99 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.413297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e58a211-5e27-49a0-a9b2-0cb26978fd99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.413297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e58a211-5e27-49a0-a9b2-0cb26978fd99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.413297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e58a211-5e27-49a0-a9b2-0cb26978fd99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.413297] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e58a211-5e27-49a0-a9b2-0cb26978fd99',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.456912] env[61538]: INFO networking_nsxv3.common.synchronization [None req-e3e3519e-d83d-458d-90c7-676a01070bcd None None] Enqueued Resource ID: f9c01d2e-2741-4569-931b-5a69d3bf7e8a with Priority: HIGHEST for action port [ 689.458826] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c01d2e-2741-4569-931b-5a69d3bf7e8a with Priority: HIGHEST for action port [ 689.460381] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9c01d2e-2741-4569-931b-5a69d3bf7e8a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.460535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9c01d2e-2741-4569-931b-5a69d3bf7e8a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.460612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9c01d2e-2741-4569-931b-5a69d3bf7e8a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.461010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9c01d2e-2741-4569-931b-5a69d3bf7e8a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.461230] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9c01d2e-2741-4569-931b-5a69d3bf7e8a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.462972] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 in Status: SUCCESS [ 689.463254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.582581] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3a6fa36-755e-48b1-ab72-10594e3701ad: rpc.has_security_group_logging(os_id): False [ 689.601654] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.601901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.601901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.602113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.602222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.602604] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.602745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.602806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.602934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.603020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.603219] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.603323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.603398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.603544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.603613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.604046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.604177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.604237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.604357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.604433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.608050] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad is going to be created. [ 689.671525] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.671726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.671726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.671953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.672155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.686399] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: IN_PROGRESS for 2s [ 689.905492] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.905765] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.905765] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.906424] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.906424] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.906424] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port f3a5e417-6468-4590-aa5e-e24c16364727 not found, creating... [ 689.907212] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.907212] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.907212] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.907212] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.907455] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.907653] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.907809] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.907922] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.908655] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.908655] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.908655] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: f3a5e417-6468-4590-aa5e-e24c16364727 is going to be created. [ 689.910383] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-850cf150-e9b7-4aa9-8141-ddd003b7e560 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.914018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.914018] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.916214] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e58a211-5e27-49a0-a9b2-0cb26978fd99 with status ACTIVE [ 689.916470] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.916610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.916675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.918020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.918020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.918020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.918020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.918020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.918020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.918020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.918020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.918020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.918020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.918405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.918405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.918405] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e58a211-5e27-49a0-a9b2-0cb26978fd99 is going to be updated. [ 689.939551] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.939770] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.940904] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.941297] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.941537] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.941893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-f3a5e417-6468-4590-aa5e-e24c16364727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.944509] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.944704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.944811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.945065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.945314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.945504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e58a211-5e27-49a0-a9b2-0cb26978fd99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.969050] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9c01d2e-2741-4569-931b-5a69d3bf7e8a [ 689.970071] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.970071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.970071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.970071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.970071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.970071] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9c01d2e-2741-4569-931b-5a69d3bf7e8a already deleted. [ 689.970071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9c01d2e-2741-4569-931b-5a69d3bf7e8a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.416245] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.648045] env[61538]: INFO networking_nsxv3.common.synchronization [None req-217a793f-378e-475d-85ec-d08415a4d2d4 tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 690.648045] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 690.648045] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.648045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.648045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.648045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.648045] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.909669] env[61538]: INFO networking_nsxv3.common.synchronization [None req-457b0412-28a3-47d7-ba68-51c263175cfe None None] Enqueued Resource ID: 81a5fef5-b503-42ef-a811-1ccfa077b9e6 with Priority: HIGHEST for action port [ 690.910269] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a5fef5-b503-42ef-a811-1ccfa077b9e6 with Priority: HIGHEST for action port [ 690.910571] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-81a5fef5-b503-42ef-a811-1ccfa077b9e6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.910774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81a5fef5-b503-42ef-a811-1ccfa077b9e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.910774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81a5fef5-b503-42ef-a811-1ccfa077b9e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.911417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81a5fef5-b503-42ef-a811-1ccfa077b9e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.911417] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81a5fef5-b503-42ef-a811-1ccfa077b9e6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.921664] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.921664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.921781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.921990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.922102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.922234] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 is going to be created. [ 690.930515] env[61538]: INFO networking_nsxv3.common.synchronization [None req-218ad4e0-f22a-482c-90f2-3fb8c92cbc22 tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 690.931016] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 690.932303] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.932303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.954272] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.954272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.954422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.954596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.954808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.968547] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 in Status: UNINITIALIZED for 2s [ 691.034105] env[61538]: INFO networking_nsxv3.common.synchronization [None req-e70b863c-034a-44ad-a73f-0bc993efe3a0 None None] Enqueued Resource ID: c8a96ab4-d400-4627-a882-eff8bd276e00 with Priority: HIGHEST for action port [ 691.034105] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a96ab4-d400-4627-a882-eff8bd276e00 with Priority: HIGHEST for action port [ 691.034105] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8a96ab4-d400-4627-a882-eff8bd276e00 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.034105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8a96ab4-d400-4627-a882-eff8bd276e00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.035397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8a96ab4-d400-4627-a882-eff8bd276e00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.035971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8a96ab4-d400-4627-a882-eff8bd276e00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.036236] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8a96ab4-d400-4627-a882-eff8bd276e00',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.172222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.172429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.172429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.172708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.172914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.172914] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25706118-e879-4cb5-be84-a8ab078e932e already deleted. [ 691.173084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.173237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.173429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.173534] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.416024] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81a5fef5-b503-42ef-a811-1ccfa077b9e6 [ 691.416024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.416024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.416024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.416024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.416024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.416024] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81a5fef5-b503-42ef-a811-1ccfa077b9e6 already deleted. [ 691.416659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81a5fef5-b503-42ef-a811-1ccfa077b9e6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.539095] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8a96ab4-d400-4627-a882-eff8bd276e00 [ 691.539502] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.539680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.539807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.540099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.540252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.540350] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8a96ab4-d400-4627-a882-eff8bd276e00 already deleted. [ 691.540447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8a96ab4-d400-4627-a882-eff8bd276e00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.700767] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.700767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.700767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.700767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.700767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.700767] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25706118-e879-4cb5-be84-a8ab078e932e already deleted. [ 691.700767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.701399] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: SUCCESS [ 691.701399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.094284] env[61538]: INFO networking_nsxv3.common.synchronization [req-23ab83ea-0b63-44af-885e-c5f26269aa06 req-d45586c8-e8ef-4c1d-ace7-4b477496f1a5 service nova] Enqueued Resource ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d with Priority: HIGHEST for action security_group_rules [ 692.094284] env[61538]: INFO networking_nsxv3.common.synchronization [req-23ab83ea-0b63-44af-885e-c5f26269aa06 req-d45586c8-e8ef-4c1d-ace7-4b477496f1a5 service nova] Enqueued Resource ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d with Priority: HIGHEST for action security_group_members [ 692.094284] env[61538]: INFO networking_nsxv3.common.synchronization [req-23ab83ea-0b63-44af-885e-c5f26269aa06 req-d45586c8-e8ef-4c1d-ace7-4b477496f1a5 service nova] Enqueued Resource ID: f3a5e417-6468-4590-aa5e-e24c16364727 with Priority: HIGHEST for action port [ 692.097675] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d with Priority: HIGHEST for action security_group_rules [ 692.097675] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d with Priority: HIGHEST for action security_group_members [ 692.097675] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3a5e417-6468-4590-aa5e-e24c16364727 with Priority: HIGHEST for action port [ 692.097675] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-500d868a-59d3-4e7e-a5ec-63123eb42a2d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.097675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.097675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.097675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.097675] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('500d868a-59d3-4e7e-a5ec-63123eb42a2d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.097675] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-500d868a-59d3-4e7e-a5ec-63123eb42a2d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.097675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.097675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.097675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.097675] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.097675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.097675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.097675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.098564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.098564] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('500d868a-59d3-4e7e-a5ec-63123eb42a2d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.099131] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3a5e417-6468-4590-aa5e-e24c16364727 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.099732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3a5e417-6468-4590-aa5e-e24c16364727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.099732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3a5e417-6468-4590-aa5e-e24c16364727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.099732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3a5e417-6468-4590-aa5e-e24c16364727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.099732] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a5e417-6468-4590-aa5e-e24c16364727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.602371] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('500d868a-59d3-4e7e-a5ec-63123eb42a2d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.603401] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-500d868a-59d3-4e7e-a5ec-63123eb42a2d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.603582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.603958] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3a5e417-6468-4590-aa5e-e24c16364727 with status ACTIVE [ 692.604150] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.604366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.604572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.604841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.604960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.607816] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.607816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.608032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.608104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.608249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.608490] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.608587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.608587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.609120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.609120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.609120] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3a5e417-6468-4590-aa5e-e24c16364727 is going to be updated. [ 692.641082] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.641082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.641082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.641082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.641082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.641082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3a5e417-6468-4590-aa5e-e24c16364727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.980611] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 in Status: SUCCESS [ 692.980611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.980611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.981079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.981079] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.981079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.981240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.981274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.981358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.981439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.981530] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.111111] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('500d868a-59d3-4e7e-a5ec-63123eb42a2d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.305776] env[61538]: INFO networking_nsxv3.common.synchronization [None req-6a1e90d8-2310-4a9f-9f50-630857e9ab95 None None] Enqueued Resource ID: 8ecdc827-dd52-4728-aa85-804552eaa4a0 with Priority: HIGHEST for action port [ 693.306343] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ecdc827-dd52-4728-aa85-804552eaa4a0 with Priority: HIGHEST for action port [ 693.307347] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ecdc827-dd52-4728-aa85-804552eaa4a0 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.307347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ecdc827-dd52-4728-aa85-804552eaa4a0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.307347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ecdc827-dd52-4728-aa85-804552eaa4a0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.308090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ecdc827-dd52-4728-aa85-804552eaa4a0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.308389] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ecdc827-dd52-4728-aa85-804552eaa4a0',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.486077] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.618692] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.618879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.618944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.619345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.619466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.619558] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d is going to be created. [ 693.668345] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.668345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.668345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.668345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.668720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.681711] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d in Status: UNINITIALIZED for 2s [ 693.815386] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ecdc827-dd52-4728-aa85-804552eaa4a0 [ 693.815701] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.815865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.815966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.816241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.816334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.816421] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ecdc827-dd52-4728-aa85-804552eaa4a0 already deleted. [ 693.816500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ecdc827-dd52-4728-aa85-804552eaa4a0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.989022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 850cf150-e9b7-4aa9-8141-ddd003b7e560: rpc.has_security_group_logging(os_id): False [ 694.009184] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.010296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.010296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.010296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.010296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.010807] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.010931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.011030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.011815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.011815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.011815] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 is going to be created. [ 694.082861] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.082998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.083079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.083303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.083478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.097153] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 in Status: IN_PROGRESS for 2s [ 694.163485] env[61538]: INFO networking_nsxv3.common.synchronization [None req-d2742e14-9275-4cf6-aa61-563abc74eb23 None None] Enqueued Resource ID: 54b5d112-dffa-4185-b414-83c20a078974 with Priority: HIGHEST for action port [ 694.163485] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b5d112-dffa-4185-b414-83c20a078974 with Priority: HIGHEST for action port [ 694.163485] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-54b5d112-dffa-4185-b414-83c20a078974 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.163485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54b5d112-dffa-4185-b414-83c20a078974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.163485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54b5d112-dffa-4185-b414-83c20a078974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.163851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54b5d112-dffa-4185-b414-83c20a078974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.166860] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54b5d112-dffa-4185-b414-83c20a078974',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.663183] env[61538]: INFO networking_nsxv3.common.synchronization [None req-3d33966c-50d1-4c13-af20-5bfe9cffb4d9 tempest-VolumesAdminNegativeTest-2067435148 tempest-VolumesAdminNegativeTest-2067435148-project-member] Enqueued Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_rules [ 694.663685] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_rules [ 694.663685] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.663845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.663882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.664132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.664214] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.668689] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54b5d112-dffa-4185-b414-83c20a078974 [ 694.668872] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.668988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.669084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.669276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.669370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.669464] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54b5d112-dffa-4185-b414-83c20a078974 already deleted. [ 694.669718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54b5d112-dffa-4185-b414-83c20a078974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.692520] env[61538]: INFO networking_nsxv3.common.synchronization [req-205948f4-05d5-4aa1-b47b-a14d08f677fa req-03c5834e-94dd-4a67-9add-159d5a0e4e5c tempest-ServersWithSpecificFlavorTestJSON-1598309329 tempest-ServersWithSpecificFlavorTestJSON-1598309329-project-member] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 694.692938] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 694.693290] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.693418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.693527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.693745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.693902] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.694586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.694723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.694965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.695135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.695355] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.839056] env[61538]: INFO networking_nsxv3.common.synchronization [None req-e661cb95-cd43-4717-bb26-f36ee7a1f5b9 tempest-VolumesAdminNegativeTest-2067435148 tempest-VolumesAdminNegativeTest-2067435148-project-member] Enqueued Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_rules [ 694.839056] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_rules [ 694.840890] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.841413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.002203] env[61538]: INFO networking_nsxv3.common.synchronization [None req-18b26d79-09fc-433e-84af-cdf8f48f9366 None None] Enqueued Resource ID: ff2a8639-44a4-4d86-b19c-cd86a5a8cf32 with Priority: HIGHEST for action port [ 695.003259] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff2a8639-44a4-4d86-b19c-cd86a5a8cf32 with Priority: HIGHEST for action port [ 695.004188] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff2a8639-44a4-4d86-b19c-cd86a5a8cf32 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.004188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff2a8639-44a4-4d86-b19c-cd86a5a8cf32" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.004188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff2a8639-44a4-4d86-b19c-cd86a5a8cf32" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.004188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff2a8639-44a4-4d86-b19c-cd86a5a8cf32" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.004188] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff2a8639-44a4-4d86-b19c-cd86a5a8cf32',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.185562] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.185742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.185808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.185978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.186117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.186219] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e already deleted. [ 695.186324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.186490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.186660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.186748] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.198630] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.198812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.198911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.199140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.199239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.199445] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.199545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.199606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.200491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.200491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.200491] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e already deleted. [ 695.200491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.509706] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff2a8639-44a4-4d86-b19c-cd86a5a8cf32 [ 695.509958] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.510151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.510151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.510370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.510684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.510684] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff2a8639-44a4-4d86-b19c-cd86a5a8cf32 already deleted. [ 695.510684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff2a8639-44a4-4d86-b19c-cd86a5a8cf32" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.692383] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d in Status: SUCCESS [ 695.695323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.695551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.695803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.696030] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.696330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.696330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.696457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.696552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.696675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.696750] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('500d868a-59d3-4e7e-a5ec-63123eb42a2d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.726654] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.726654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.726654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.726654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.726654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.726654] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e already deleted. [ 695.726654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.071584] env[61538]: INFO networking_nsxv3.common.synchronization [None req-424cbd28-4580-4032-ab2a-5471fc092e6b None None] Enqueued Resource ID: 5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7 with Priority: HIGHEST for action port [ 696.072579] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7 with Priority: HIGHEST for action port [ 696.072579] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.072579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.073293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.073293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.073293] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.129221] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 in Status: SUCCESS [ 696.129221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.177817] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.177817] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-521" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.177817] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-521" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.177817] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-521" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.177817] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.177817] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.179910] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.179910] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.179910] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.180202] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.180310] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.180443] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.180558] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.180675] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.180817] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.181293] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.199844] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-500d868a-59d3-4e7e-a5ec-63123eb42a2d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.199924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.199963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.200238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.200436] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.200548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.200615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.200961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.201078] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.201176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.201369] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-500d868a-59d3-4e7e-a5ec-63123eb42a2d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.201708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.201801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.201961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.202119] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.202216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.202298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.202421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.202516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.202572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.202661] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('500d868a-59d3-4e7e-a5ec-63123eb42a2d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.211579] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.211579] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.211579] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.211579] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-521" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.212015] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.212015] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.212015] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.212369] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.215032] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53f2ef34-f0c8-46d5-86d1-b21ecc745ad5',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.577588] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7 [ 696.579509] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.579509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.579509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.579509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.579509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.579509] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7 already deleted. [ 696.579509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aad99aa-d41e-4dc2-92e8-f7cf86fdeaf7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.708131] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 500d868a-59d3-4e7e-a5ec-63123eb42a2d: rpc.has_security_group_logging(os_id): False [ 696.725025] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.725025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.725338] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.726092] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.726092] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.726092] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 53f2ef34-f0c8-46d5-86d1-b21ecc745ad5 not found, creating... [ 696.726550] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.726619] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.727248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.727248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.727248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.727505] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.730346] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.730346] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.730346] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.730346] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.730346] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 53f2ef34-f0c8-46d5-86d1-b21ecc745ad5 is going to be created. [ 696.730675] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.730675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.730675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.730797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.730831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.732290] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.732290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.732290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.732482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.732482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.732863] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.732863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.732863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.733050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.733084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.733597] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.733597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.733597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.733597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.733796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.733796] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d is going to be created. [ 696.762825] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.763025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.763241] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.763525] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.763729] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.764016] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.810013] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.810230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.810308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.810530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.810714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.837773] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d in Status: IN_PROGRESS for 2s [ 697.329217] env[61538]: INFO networking_nsxv3.common.synchronization [req-3801f7c6-2ba6-4ed5-95f0-0b41eeb7db25 req-53e974d4-7032-4baf-b5d1-37c89df23762 tempest-InstanceActionsTestJSON-1766073935 tempest-InstanceActionsTestJSON-1766073935-project-member] Enqueued Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGHEST for action security_group_members [ 697.335837] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGHEST for action security_group_members [ 697.335837] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc67a55-ecea-4935-9926-a0733e53d126 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.335837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.335837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.335837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.335837] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.335837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.335837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.335837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.335837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.335837] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc67a55-ecea-4935-9926-a0733e53d126',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.842853] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.842853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.842853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.842853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.842853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.842853] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.842853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.842853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.842853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.842853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.842853] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc67a55-ecea-4935-9926-a0733e53d126 is going to be updated. [ 697.875757] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.877134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.877134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.877134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.877265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.890376] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc67a55-ecea-4935-9926-a0733e53d126 in Status: IN_PROGRESS for 2s [ 698.050865] env[61538]: INFO networking_nsxv3.common.synchronization [req-205948f4-05d5-4aa1-b47b-a14d08f677fa req-78b03520-757e-497f-9925-cb5ab5250495 service nova] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_rules [ 698.051762] env[61538]: INFO networking_nsxv3.common.synchronization [req-205948f4-05d5-4aa1-b47b-a14d08f677fa req-78b03520-757e-497f-9925-cb5ab5250495 service nova] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 698.052784] env[61538]: INFO networking_nsxv3.common.synchronization [req-205948f4-05d5-4aa1-b47b-a14d08f677fa req-78b03520-757e-497f-9925-cb5ab5250495 service nova] Enqueued Resource ID: 53f2ef34-f0c8-46d5-86d1-b21ecc745ad5 with Priority: HIGHEST for action port [ 698.056806] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_rules [ 698.056806] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 698.056806] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53f2ef34-f0c8-46d5-86d1-b21ecc745ad5 with Priority: HIGHEST for action port [ 698.056806] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.056806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.056806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.056806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.056806] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.057974] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.057974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.057974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.058863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.060123] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.060123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.060123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.060123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.060123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.060123] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.063109] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.063109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.063109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.063109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.063109] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53f2ef34-f0c8-46d5-86d1-b21ecc745ad5',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.173525] env[61538]: INFO networking_nsxv3.common.synchronization [None req-4627d403-a699-422c-874f-31d3719cea4e None None] Enqueued Resource ID: 1522142e-56c4-4b86-a6a2-96e1258ddebe with Priority: HIGHEST for action port [ 698.175443] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1522142e-56c4-4b86-a6a2-96e1258ddebe with Priority: HIGHEST for action port [ 698.175443] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-1522142e-56c4-4b86-a6a2-96e1258ddebe taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.175739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1522142e-56c4-4b86-a6a2-96e1258ddebe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.175739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1522142e-56c4-4b86-a6a2-96e1258ddebe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.175926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1522142e-56c4-4b86-a6a2-96e1258ddebe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.175926] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1522142e-56c4-4b86-a6a2-96e1258ddebe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.566624] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.567025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.567170] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53f2ef34-f0c8-46d5-86d1-b21ecc745ad5 with status ACTIVE [ 698.567230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.567349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.567412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.567624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.567763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.567865] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.567981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.568037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.568157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.568232] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.568406] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.568493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.568552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.568684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.568753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.568953] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53f2ef34-f0c8-46d5-86d1-b21ecc745ad5 is going to be updated. [ 698.570556] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.603167] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.603167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.603167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.603167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.603414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.603452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53f2ef34-f0c8-46d5-86d1-b21ecc745ad5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.679271] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1522142e-56c4-4b86-a6a2-96e1258ddebe [ 698.679514] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.679650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.679716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.679917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.680017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.680150] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1522142e-56c4-4b86-a6a2-96e1258ddebe already deleted. [ 698.680312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1522142e-56c4-4b86-a6a2-96e1258ddebe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.855123] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d in Status: SUCCESS [ 698.855123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.075043] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.577657] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.578047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.578047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.578118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.578210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.578309] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e is going to be created. [ 699.619983] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.619983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.619983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.619983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.620243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.633619] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: UNINITIALIZED for 2s [ 700.148350] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc67a55-ecea-4935-9926-a0733e53d126 in Status: SUCCESS [ 700.148468] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc67a55-ecea-4935-9926-a0733e53d126 deletion is rescheduled due to dependency. [ 700.148693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.289899] env[61538]: INFO networking_nsxv3.common.synchronization [None req-0f64f3d0-f5bd-42c1-bd68-20b604aca04c None None] Enqueued Resource ID: 2a91ed2e-358d-4acc-8a1f-a21e0f60a325 with Priority: HIGHEST for action port [ 700.290822] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a91ed2e-358d-4acc-8a1f-a21e0f60a325 with Priority: HIGHEST for action port [ 700.290822] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a91ed2e-358d-4acc-8a1f-a21e0f60a325 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.290947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a91ed2e-358d-4acc-8a1f-a21e0f60a325" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.290947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a91ed2e-358d-4acc-8a1f-a21e0f60a325" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.291269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a91ed2e-358d-4acc-8a1f-a21e0f60a325" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.292168] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a91ed2e-358d-4acc-8a1f-a21e0f60a325',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.794933] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a91ed2e-358d-4acc-8a1f-a21e0f60a325 [ 700.795349] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.795349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.795536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.795634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.795706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.795871] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a91ed2e-358d-4acc-8a1f-a21e0f60a325 already deleted. [ 700.795871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a91ed2e-358d-4acc-8a1f-a21e0f60a325" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.559379] env[61538]: INFO networking_nsxv3.common.synchronization [req-8d73ac81-f036-48c9-b397-5442cf6e0422 req-b8170813-b33d-4d93-a9aa-644ba70fbaaa tempest-InstanceActionsV221TestJSON-1438125054 tempest-InstanceActionsV221TestJSON-1438125054-project-member] Enqueued Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGHEST for action security_group_members [ 701.563023] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGHEST for action security_group_members [ 701.563023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.563023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.563023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.563023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.563023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.563023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.563635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.563635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.563635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.563635] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea2928f0-ca1a-4287-ba3e-ef5db6d0b393',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.644980] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: SUCCESS [ 701.645191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.645363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.645582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.645773] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.645887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.645951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.646110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.646346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.646460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.646551] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.068100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.068408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.068450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.068784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.068932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.069306] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.069800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.069800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.069800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.070145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.070291] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 is going to be updated. [ 702.078465] env[61538]: INFO networking_nsxv3.common.synchronization [None req-8be7d02f-964c-4f4f-add6-cf7a893c6b18 None None] Enqueued Resource ID: 450c32dc-513c-4f43-9cac-01cbc9d35ff7 with Priority: HIGHEST for action port [ 702.078465] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 450c32dc-513c-4f43-9cac-01cbc9d35ff7 with Priority: HIGHEST for action port [ 702.078465] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-450c32dc-513c-4f43-9cac-01cbc9d35ff7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.078465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-450c32dc-513c-4f43-9cac-01cbc9d35ff7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.078465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-450c32dc-513c-4f43-9cac-01cbc9d35ff7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.078465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-450c32dc-513c-4f43-9cac-01cbc9d35ff7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.078465] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('450c32dc-513c-4f43-9cac-01cbc9d35ff7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.108727] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.110227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.110227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.110227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.110227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.122642] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 in Status: IN_PROGRESS for 2s [ 702.153177] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.585621] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 450c32dc-513c-4f43-9cac-01cbc9d35ff7 [ 702.585621] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.585621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.585621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.585621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.585621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.585621] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:450c32dc-513c-4f43-9cac-01cbc9d35ff7 already deleted. [ 702.585621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-450c32dc-513c-4f43-9cac-01cbc9d35ff7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.658855] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 463a8c39-ee54-4fb8-a9f5-3967b4233a2e: rpc.has_security_group_logging(os_id): False [ 702.675887] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.676025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.676145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.676334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.676400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.676648] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.676752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.676816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.676970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.677064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.677151] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e is going to be created. [ 702.774598] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.775990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.775990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.775990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.775990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.796467] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: IN_PROGRESS for 2s [ 703.155597] env[61538]: INFO networking_nsxv3.common.synchronization [None req-94f2a9eb-deed-4486-9295-099d3e267dbd None None] Enqueued Resource ID: fb62220a-8c35-43aa-aebc-f9f361f9d473 with Priority: HIGHEST for action port [ 703.156208] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb62220a-8c35-43aa-aebc-f9f361f9d473 with Priority: HIGHEST for action port [ 703.156520] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb62220a-8c35-43aa-aebc-f9f361f9d473 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.156653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb62220a-8c35-43aa-aebc-f9f361f9d473" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.156730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb62220a-8c35-43aa-aebc-f9f361f9d473" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.156999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb62220a-8c35-43aa-aebc-f9f361f9d473" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.159040] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb62220a-8c35-43aa-aebc-f9f361f9d473',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.266715] env[61538]: INFO networking_nsxv3.common.synchronization [None req-583e662e-6d91-444a-8ae9-dc469a8e90e4 None None] Enqueued Resource ID: d9a772ac-e59e-4c96-9675-e229772f59b8 with Priority: HIGHEST for action port [ 703.267453] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a772ac-e59e-4c96-9675-e229772f59b8 with Priority: HIGHEST for action port [ 703.267786] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9a772ac-e59e-4c96-9675-e229772f59b8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.267922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9a772ac-e59e-4c96-9675-e229772f59b8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.267988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9a772ac-e59e-4c96-9675-e229772f59b8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.268276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9a772ac-e59e-4c96-9675-e229772f59b8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.268352] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9a772ac-e59e-4c96-9675-e229772f59b8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.660769] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb62220a-8c35-43aa-aebc-f9f361f9d473 [ 703.662454] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.662686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.662724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.663285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.663789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.663789] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb62220a-8c35-43aa-aebc-f9f361f9d473 already deleted. [ 703.663948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb62220a-8c35-43aa-aebc-f9f361f9d473" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.773387] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9a772ac-e59e-4c96-9675-e229772f59b8 [ 703.773387] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.773740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.773740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.773804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.773914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.774311] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9a772ac-e59e-4c96-9675-e229772f59b8 already deleted. [ 703.774311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9a772ac-e59e-4c96-9675-e229772f59b8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.975041] env[61538]: INFO networking_nsxv3.common.synchronization [None req-780572dc-4736-4a2e-a9eb-6c3f131d9fa8 None None] Enqueued Resource ID: 78eaf66c-c37f-4926-93c0-781d1e5fc5f9 with Priority: HIGHEST for action port [ 703.975041] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eaf66c-c37f-4926-93c0-781d1e5fc5f9 with Priority: HIGHEST for action port [ 703.975041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-78eaf66c-c37f-4926-93c0-781d1e5fc5f9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.975041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78eaf66c-c37f-4926-93c0-781d1e5fc5f9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.975041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78eaf66c-c37f-4926-93c0-781d1e5fc5f9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.977160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78eaf66c-c37f-4926-93c0-781d1e5fc5f9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.977160] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78eaf66c-c37f-4926-93c0-781d1e5fc5f9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.137671] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 in Status: SUCCESS [ 704.137862] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 deletion is rescheduled due to dependency. [ 704.137979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.482141] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78eaf66c-c37f-4926-93c0-781d1e5fc5f9 [ 704.486175] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.486175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.486175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.486175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.486175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.486175] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78eaf66c-c37f-4926-93c0-781d1e5fc5f9 already deleted. [ 704.486175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78eaf66c-c37f-4926-93c0-781d1e5fc5f9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.809630] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: SUCCESS [ 704.809630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.800115] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1d5c8f8d-3ef2-4563-9b09-f8c595eadcf8 None None] Enqueued Resource ID: 34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf with Priority: HIGHEST for action port [ 705.805131] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf with Priority: HIGHEST for action port [ 705.805131] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.805131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.805131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.805131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.805131] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.907197] env[61538]: INFO networking_nsxv3.common.synchronization [req-26ece35d-f9eb-42dc-95fe-a7c4da4e92cf req-e589b659-47d7-4432-ae34-82894dd3baf5 tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 705.907197] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 705.907197] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.907197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.907197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.909221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.909221] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.909221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.909221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.909221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.909221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.909221] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.308263] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf [ 706.308568] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.308727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.309066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.309346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.309465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.309536] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf already deleted. [ 706.309853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34b7b1b0-3f36-4fb9-8f2c-434c03ea0ebf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.413848] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.414029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.414107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.414341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.414451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.414621] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.414723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.414778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.414931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.415020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.415250] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b already deleted. [ 706.415250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.803984] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.804379] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.804379] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.804732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.804948] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.805401] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.805655] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.806882] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.807615] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.808260] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.808318] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.808452] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.808729] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.808729] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.808912] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.809129] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.837063] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.840396] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.840396] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.840396] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.840396] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-f8265baf-2284-40a0-b20a-88199fb2bbda taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.840396] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-f8265baf-2284-40a0-b20a-88199fb2bbda" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.840396] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-f8265baf-2284-40a0-b20a-88199fb2bbda" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.840802] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-f8265baf-2284-40a0-b20a-88199fb2bbda" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.840802] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8265baf-2284-40a0-b20a-88199fb2bbda',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.191469] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1a9f0efc-a3fb-453c-a87a-aa00d32207de None None] Enqueued Resource ID: dbbd57d3-02cf-457e-bd29-bfe8b7810128 with Priority: HIGHEST for action port [ 707.191469] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbbd57d3-02cf-457e-bd29-bfe8b7810128 with Priority: HIGHEST for action port [ 707.192097] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbbd57d3-02cf-457e-bd29-bfe8b7810128 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.192242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbbd57d3-02cf-457e-bd29-bfe8b7810128" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.192242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbbd57d3-02cf-457e-bd29-bfe8b7810128" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.192499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbbd57d3-02cf-457e-bd29-bfe8b7810128" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.192585] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbbd57d3-02cf-457e-bd29-bfe8b7810128',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.350949] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.351296] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.351519] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.351875] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.352151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.352385] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port f8265baf-2284-40a0-b20a-88199fb2bbda not found, creating... [ 707.352995] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.352995] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.353185] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.353527] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.353769] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.354870] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.358058] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.358058] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.358058] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.358058] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.358058] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: f8265baf-2284-40a0-b20a-88199fb2bbda is going to be created. [ 707.385144] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.385491] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.389882] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.389882] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.389882] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.390270] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-f8265baf-2284-40a0-b20a-88199fb2bbda" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.696372] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbbd57d3-02cf-457e-bd29-bfe8b7810128 [ 707.697948] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.699858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.699858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.701080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.701080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.701080] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbbd57d3-02cf-457e-bd29-bfe8b7810128 already deleted. [ 707.701080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbbd57d3-02cf-457e-bd29-bfe8b7810128" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.795258] env[61538]: INFO networking_nsxv3.common.synchronization [None req-267f7c15-6262-4c0b-89e0-0950b1861fbe None None] Enqueued Resource ID: 9dcc5e13-38de-4ac8-91a6-15d9fbe5b014 with Priority: HIGHEST for action port [ 707.796403] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dcc5e13-38de-4ac8-91a6-15d9fbe5b014 with Priority: HIGHEST for action port [ 707.798154] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dcc5e13-38de-4ac8-91a6-15d9fbe5b014 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.798308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dcc5e13-38de-4ac8-91a6-15d9fbe5b014" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.798454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dcc5e13-38de-4ac8-91a6-15d9fbe5b014" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.798660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dcc5e13-38de-4ac8-91a6-15d9fbe5b014" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.798766] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dcc5e13-38de-4ac8-91a6-15d9fbe5b014',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.176023] env[61538]: INFO networking_nsxv3.common.synchronization [None req-ea856641-d518-4ba3-913e-5802b09c6270 None None] Enqueued Resource ID: ca483dca-24e6-48bb-bb6f-0a9844809bc3 with Priority: HIGHEST for action port [ 708.176023] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca483dca-24e6-48bb-bb6f-0a9844809bc3 with Priority: HIGHEST for action port [ 708.176372] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca483dca-24e6-48bb-bb6f-0a9844809bc3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.176372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca483dca-24e6-48bb-bb6f-0a9844809bc3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.176466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca483dca-24e6-48bb-bb6f-0a9844809bc3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.176683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca483dca-24e6-48bb-bb6f-0a9844809bc3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.176799] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca483dca-24e6-48bb-bb6f-0a9844809bc3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.301406] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dcc5e13-38de-4ac8-91a6-15d9fbe5b014 [ 708.301660] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.301788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.301844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.302431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.302431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.302431] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dcc5e13-38de-4ac8-91a6-15d9fbe5b014 already deleted. [ 708.302431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dcc5e13-38de-4ac8-91a6-15d9fbe5b014" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.536186] env[61538]: INFO networking_nsxv3.common.synchronization [req-26ece35d-f9eb-42dc-95fe-a7c4da4e92cf req-94662bcc-b1d1-46eb-a83a-5daabfb75880 service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 708.537221] env[61538]: INFO networking_nsxv3.common.synchronization [req-26ece35d-f9eb-42dc-95fe-a7c4da4e92cf req-94662bcc-b1d1-46eb-a83a-5daabfb75880 service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 708.539260] env[61538]: INFO networking_nsxv3.common.synchronization [req-26ece35d-f9eb-42dc-95fe-a7c4da4e92cf req-94662bcc-b1d1-46eb-a83a-5daabfb75880 service nova] Enqueued Resource ID: f8265baf-2284-40a0-b20a-88199fb2bbda with Priority: HIGHEST for action port [ 708.539260] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 708.539796] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 708.539972] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8265baf-2284-40a0-b20a-88199fb2bbda with Priority: HIGHEST for action port [ 708.540821] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.540932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.541028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.541373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.541447] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.543333] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.543701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.543762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.543969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.544808] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.544808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.544808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.544808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.545580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.545580] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.548790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8265baf-2284-40a0-b20a-88199fb2bbda taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.549093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8265baf-2284-40a0-b20a-88199fb2bbda" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.549328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8265baf-2284-40a0-b20a-88199fb2bbda" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.549611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8265baf-2284-40a0-b20a-88199fb2bbda" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.550704] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8265baf-2284-40a0-b20a-88199fb2bbda',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.679531] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca483dca-24e6-48bb-bb6f-0a9844809bc3 [ 708.680426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.680426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.680426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.680426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.680426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.680426] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca483dca-24e6-48bb-bb6f-0a9844809bc3 already deleted. [ 708.680426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca483dca-24e6-48bb-bb6f-0a9844809bc3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.918029] env[61538]: INFO networking_nsxv3.common.synchronization [req-6912a313-19f8-45fc-acf2-5449a4fc7c70 req-227bc4c8-a055-4917-9c91-e8aeee575032 tempest-ImagesNegativeTestJSON-1172652629 tempest-ImagesNegativeTestJSON-1172652629-project-member] Enqueued Resource ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d with Priority: HIGHEST for action security_group_members [ 708.918765] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d with Priority: HIGHEST for action security_group_members [ 708.922542] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-500d868a-59d3-4e7e-a5ec-63123eb42a2d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.923828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.923828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.923828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.923828] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.923828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.923828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.923828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.923828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.923828] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('500d868a-59d3-4e7e-a5ec-63123eb42a2d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.044494] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.045030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.055520] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.055520] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8265baf-2284-40a0-b20a-88199fb2bbda with status ACTIVE [ 709.055520] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.056166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.056166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.056166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.056166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.056166] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.056380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.056380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.058114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.058114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.058114] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.058114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.058114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.058114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.058114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.058114] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8265baf-2284-40a0-b20a-88199fb2bbda is going to be updated. [ 709.094446] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.094446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.094446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.094446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.094446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.094446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8265baf-2284-40a0-b20a-88199fb2bbda" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.428064] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.428064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.428064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.428582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.428582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.429312] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.429312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.429312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.429312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.429312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.429654] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d is going to be updated. [ 709.459147] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.459292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.459292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.459522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.459697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.471304] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d in Status: IN_PROGRESS for 2s [ 709.562550] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.064993] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.065141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.065243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.065546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.065645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.065748] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be created. [ 710.093663] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.093889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.093889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.094104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.094261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.104633] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: UNINITIALIZED for 2s [ 710.619570] env[61538]: INFO networking_nsxv3.common.synchronization [req-e2adde62-41fc-4a52-a9a1-6b8f9bc79c16 req-c8cb76a7-ca1d-4390-a6de-e41c08be3ded tempest-SecurityGroupRulesTestJSON-258852506 tempest-SecurityGroupRulesTestJSON-258852506-project-member] Enqueued Resource ID: 5d85e2f0-6fde-4651-88a6-c6d1aabf41c7 with Priority: HIGHEST for action security_group_rules [ 710.620523] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d85e2f0-6fde-4651-88a6-c6d1aabf41c7 with Priority: HIGHEST for action security_group_rules [ 710.621316] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d85e2f0-6fde-4651-88a6-c6d1aabf41c7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.621534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d85e2f0-6fde-4651-88a6-c6d1aabf41c7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.621652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d85e2f0-6fde-4651-88a6-c6d1aabf41c7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.622158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d85e2f0-6fde-4651-88a6-c6d1aabf41c7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.622287] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d85e2f0-6fde-4651-88a6-c6d1aabf41c7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.145102] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.145379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.145379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.145558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.145647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.145744] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d85e2f0-6fde-4651-88a6-c6d1aabf41c7 already deleted. [ 711.145830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d85e2f0-6fde-4651-88a6-c6d1aabf41c7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.482716] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d in Status: SUCCESS [ 711.482891] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 500d868a-59d3-4e7e-a5ec-63123eb42a2d deletion is rescheduled due to dependency. [ 711.483015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500d868a-59d3-4e7e-a5ec-63123eb42a2d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.116292] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 712.116664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.116664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.116824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.117020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.117155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.117217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.117379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.117461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.117546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.117763] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.494150] env[61538]: INFO networking_nsxv3.common.synchronization [req-4b9e0fd1-5e87-47b0-bcc8-77c8ec4af249 req-0f4b2c60-3984-4170-8618-3343db7adc65 tempest-SecurityGroupRulesTestJSON-258852506 tempest-SecurityGroupRulesTestJSON-258852506-project-member] Enqueued Resource ID: 68883392-9db1-4974-a282-863f6307b2de with Priority: HIGHEST for action security_group_rules [ 712.494808] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68883392-9db1-4974-a282-863f6307b2de with Priority: HIGHEST for action security_group_rules [ 712.495205] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68883392-9db1-4974-a282-863f6307b2de taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.495378] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68883392-9db1-4974-a282-863f6307b2de" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.496603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68883392-9db1-4974-a282-863f6307b2de" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.496970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68883392-9db1-4974-a282-863f6307b2de" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.497368] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68883392-9db1-4974-a282-863f6307b2de',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.622633] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.622816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.622910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.623314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.623645] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.623645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.623789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.623939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.624073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.624174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.624368] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.624517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.624585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.625141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.625141] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.625141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.625580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.625580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.625580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.625580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.625738] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.022544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.023612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.023724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.023930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.024032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.024134] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68883392-9db1-4974-a282-863f6307b2de already deleted. [ 713.024229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68883392-9db1-4974-a282-863f6307b2de" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.130519] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b: rpc.has_security_group_logging(os_id): False [ 713.150026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.150385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.153021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.153021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.153021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.153021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.153564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.153564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.153564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.153564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.153564] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be created. [ 713.213210] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.213210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.213349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.213563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.213742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.228722] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 715.143377] env[61538]: INFO networking_nsxv3.common.synchronization [req-43ba602a-09a8-4125-b8e1-796be4295964 req-8d3e42b0-65d7-4124-8803-72e56cc94158 tempest-SecurityGroupRulesTestJSON-258852506 tempest-SecurityGroupRulesTestJSON-258852506-project-member] Enqueued Resource ID: b0c13486-1519-48d7-bf92-79c8692016dc with Priority: HIGHEST for action security_group_rules [ 715.144021] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0c13486-1519-48d7-bf92-79c8692016dc with Priority: HIGHEST for action security_group_rules [ 715.144353] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0c13486-1519-48d7-bf92-79c8692016dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.144471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0c13486-1519-48d7-bf92-79c8692016dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.144554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0c13486-1519-48d7-bf92-79c8692016dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.144786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0c13486-1519-48d7-bf92-79c8692016dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.144864] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0c13486-1519-48d7-bf92-79c8692016dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.243551] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 715.243667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.668356] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.668547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.668645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.670020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.670020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.670020] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0c13486-1519-48d7-bf92-79c8692016dc already deleted. [ 715.670020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0c13486-1519-48d7-bf92-79c8692016dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.709152] env[61538]: INFO networking_nsxv3.common.synchronization [None req-8b15a550-d280-4ffb-9f34-4615b6fa54f1 None None] Enqueued Resource ID: 9f5fc54b-307c-472f-a30e-982cd533c20e with Priority: HIGHEST for action port [ 715.709322] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5fc54b-307c-472f-a30e-982cd533c20e with Priority: HIGHEST for action port [ 715.709667] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f5fc54b-307c-472f-a30e-982cd533c20e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.709797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f5fc54b-307c-472f-a30e-982cd533c20e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.709864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f5fc54b-307c-472f-a30e-982cd533c20e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.712502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f5fc54b-307c-472f-a30e-982cd533c20e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.712608] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f5fc54b-307c-472f-a30e-982cd533c20e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.953830] env[61538]: INFO networking_nsxv3.common.synchronization [None req-e5371c47-e5d5-491e-b443-946482a7eada None None] Enqueued Resource ID: 110e18f0-1bfc-441f-bb0c-7582213a3f4f with Priority: HIGHEST for action port [ 715.954440] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110e18f0-1bfc-441f-bb0c-7582213a3f4f with Priority: HIGHEST for action port [ 715.954747] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-110e18f0-1bfc-441f-bb0c-7582213a3f4f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.954858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-110e18f0-1bfc-441f-bb0c-7582213a3f4f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.954926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-110e18f0-1bfc-441f-bb0c-7582213a3f4f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.955345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-110e18f0-1bfc-441f-bb0c-7582213a3f4f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.955450] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('110e18f0-1bfc-441f-bb0c-7582213a3f4f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.219230] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f5fc54b-307c-472f-a30e-982cd533c20e [ 716.219230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.219230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.219230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.219230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.219230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.219230] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f5fc54b-307c-472f-a30e-982cd533c20e already deleted. [ 716.219230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f5fc54b-307c-472f-a30e-982cd533c20e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.458729] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 110e18f0-1bfc-441f-bb0c-7582213a3f4f [ 716.458866] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.459020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.459090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.459306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.459400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.459500] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:110e18f0-1bfc-441f-bb0c-7582213a3f4f already deleted. [ 716.459610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-110e18f0-1bfc-441f-bb0c-7582213a3f4f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.445847] env[61538]: INFO networking_nsxv3.common.synchronization [req-2c42426e-d2b4-46e0-b2a4-efd2bad360c0 req-ccf24211-dda8-4d48-9dc0-4c89e96f14c7 tempest-ServersAdminNegativeTestJSON-1477357562 tempest-ServersAdminNegativeTestJSON-1477357562-project-member] Enqueued Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 717.445847] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 717.452967] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.452967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.452967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.452967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.452967] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.452967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.452967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.452967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.452967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.452967] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.956981] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.975603] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c970cb34-1ef1-4677-91b8-a71ae7f967ac None None] Enqueued Resource ID: 394c4da7-76f2-4690-974a-efe169ad8631 with Priority: HIGHEST for action port [ 717.976228] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394c4da7-76f2-4690-974a-efe169ad8631 with Priority: HIGHEST for action port [ 717.976959] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-394c4da7-76f2-4690-974a-efe169ad8631 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.976959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-394c4da7-76f2-4690-974a-efe169ad8631" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.976959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-394c4da7-76f2-4690-974a-efe169ad8631" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.977216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-394c4da7-76f2-4690-974a-efe169ad8631" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.977260] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('394c4da7-76f2-4690-974a-efe169ad8631',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.101889] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.102538] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.102744] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.103084] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.103640] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.103898] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.104216] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.104519] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.104895] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.105347] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.105775] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.105775] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.105775] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.106244] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.106428] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.106613] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.129468] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.129651] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 718.131016] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.131016] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.131016] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.131016] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.131016] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.131016] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.131521] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9fecc2f-82bc-401e-b2ac-6d840b6e25be',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.162934] env[61538]: INFO networking_nsxv3.common.synchronization [req-d672f56e-ac25-4c7e-9c19-c0db450107dc req-1bd01bed-4ff5-4eb0-94cd-de026a14db2e tempest-SecurityGroupRulesTestJSON-258852506 tempest-SecurityGroupRulesTestJSON-258852506-project-member] Enqueued Resource ID: 6233c0d9-78eb-4296-89cd-b8bb74a31ecc with Priority: HIGHEST for action security_group_rules [ 718.163497] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6233c0d9-78eb-4296-89cd-b8bb74a31ecc with Priority: HIGHEST for action security_group_rules [ 718.163798] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6233c0d9-78eb-4296-89cd-b8bb74a31ecc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.164126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6233c0d9-78eb-4296-89cd-b8bb74a31ecc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.164126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6233c0d9-78eb-4296-89cd-b8bb74a31ecc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.164272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6233c0d9-78eb-4296-89cd-b8bb74a31ecc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.164322] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6233c0d9-78eb-4296-89cd-b8bb74a31ecc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.459586] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.479714] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 394c4da7-76f2-4690-974a-efe169ad8631 [ 718.480271] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.480390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.480433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.480965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.480965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.481676] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:394c4da7-76f2-4690-974a-efe169ad8631 already deleted. [ 718.481676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-394c4da7-76f2-4690-974a-efe169ad8631" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.634125] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.634967] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.634967] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.635355] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.635576] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.635836] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port a9fecc2f-82bc-401e-b2ac-6d840b6e25be not found, creating... [ 718.636771] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.636771] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.636962] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.637251] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.637449] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.637777] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.637947] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.638576] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.638576] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.638576] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.638716] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: a9fecc2f-82bc-401e-b2ac-6d840b6e25be is going to be created. [ 718.642271] env[61538]: INFO networking_nsxv3.common.synchronization [None req-4b3af940-ce60-447a-9b2d-6678504e2cfe None None] Enqueued Resource ID: 670bce67-0bf7-4415-8b86-737264922033 with Priority: HIGHEST for action port [ 718.642838] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670bce67-0bf7-4415-8b86-737264922033 with Priority: HIGHEST for action port [ 718.643454] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-670bce67-0bf7-4415-8b86-737264922033 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.643584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-670bce67-0bf7-4415-8b86-737264922033" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.643661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-670bce67-0bf7-4415-8b86-737264922033" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.643983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-670bce67-0bf7-4415-8b86-737264922033" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.643983] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('670bce67-0bf7-4415-8b86-737264922033',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.663240] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.663609] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.663609] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.663691] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.663912] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.664178] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.686039] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.686182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.686257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.686492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.686595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.686679] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6233c0d9-78eb-4296-89cd-b8bb74a31ecc already deleted. [ 718.686841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6233c0d9-78eb-4296-89cd-b8bb74a31ecc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.964149] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.965756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.965756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.965756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.965756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.965756] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc is going to be updated. [ 719.000378] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.002038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.002038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.002038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.002038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.012507] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: IN_PROGRESS for 2s [ 719.147479] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 670bce67-0bf7-4415-8b86-737264922033 [ 719.147671] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.147811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.147976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.148162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.148422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.148422] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:670bce67-0bf7-4415-8b86-737264922033 already deleted. [ 719.148549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-670bce67-0bf7-4415-8b86-737264922033" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.659745] env[61538]: INFO networking_nsxv3.common.synchronization [req-2c42426e-d2b4-46e0-b2a4-efd2bad360c0 req-7f12bd26-3b7d-4c82-a761-f0100c569fd0 service nova] Enqueued Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_rules [ 719.659745] env[61538]: INFO networking_nsxv3.common.synchronization [req-2c42426e-d2b4-46e0-b2a4-efd2bad360c0 req-7f12bd26-3b7d-4c82-a761-f0100c569fd0 service nova] Enqueued Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 719.660253] env[61538]: INFO networking_nsxv3.common.synchronization [req-2c42426e-d2b4-46e0-b2a4-efd2bad360c0 req-7f12bd26-3b7d-4c82-a761-f0100c569fd0 service nova] Enqueued Resource ID: a9fecc2f-82bc-401e-b2ac-6d840b6e25be with Priority: HIGHEST for action port [ 719.661167] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_rules [ 719.661167] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 719.661167] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fecc2f-82bc-401e-b2ac-6d840b6e25be with Priority: HIGHEST for action port [ 719.661167] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.661167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.661505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.661841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.661841] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.663477] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.663477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.663477] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.663477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.663477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.663477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.664243] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9fecc2f-82bc-401e-b2ac-6d840b6e25be',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.109709] env[61538]: INFO networking_nsxv3.common.synchronization [req-abc39ded-3e5d-4e5d-9aae-534aa17c1993 req-1a91377a-ee6e-4f36-b5eb-d3f5bc086334 tempest-DeleteServersAdminTestJSON-1595240936 tempest-DeleteServersAdminTestJSON-1595240936-project-member] Enqueued Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 720.110116] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 720.110428] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.110911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.110989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.112453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.112631] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.112741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.112807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.112967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.113066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.113245] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.165959] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.166127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.167661] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9fecc2f-82bc-401e-b2ac-6d840b6e25be with status ACTIVE [ 720.167740] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.167862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.168065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.168247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.168247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.168404] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.168498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.168809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.168809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.168809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.171248] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.171248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.171248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.171248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.171248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.171248] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9fecc2f-82bc-401e-b2ac-6d840b6e25be is going to be updated. [ 720.198091] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.198270] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.198343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.198546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.198695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.198856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9fecc2f-82bc-401e-b2ac-6d840b6e25be" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.619597] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.619597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.619597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.619597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.619597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.619597] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.619597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.619597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.619597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.619597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.619597] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d is going to be updated. [ 720.649308] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.649528] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.649663] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.649946] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.650317] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.650400] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.653765] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.653765] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.653765] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.653765] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.653765] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.653765] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.653765] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.653765] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.653765] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.653765] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.654990] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.655150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.655729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.655729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.655729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.666147] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: IN_PROGRESS for 2s [ 720.684374] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.684518] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.684556] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.686180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.686180] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-44c7a5f7-291c-4f82-ab36-b2612b504432 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.686180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-44c7a5f7-291c-4f82-ab36-b2612b504432" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.686180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-44c7a5f7-291c-4f82-ab36-b2612b504432" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.686180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-44c7a5f7-291c-4f82-ab36-b2612b504432" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.686180] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44c7a5f7-291c-4f82-ab36-b2612b504432',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.110216] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: SUCCESS [ 721.110216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.110216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.110416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.110620] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.110744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.110805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.110970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.111064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.111166] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.192207] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.192477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.192568] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.192867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.193035] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.193200] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 44c7a5f7-291c-4f82-ab36-b2612b504432 not found, creating... [ 721.193474] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.193642] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.193763] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.194058] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.194235] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.194932] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.197329] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.197533] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.198299] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.198513] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.198678] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 44c7a5f7-291c-4f82-ab36-b2612b504432 is going to be created. [ 721.219159] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.219438] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.219587] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.219948] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.220244] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.220437] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-44c7a5f7-291c-4f82-ab36-b2612b504432" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.613710] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.116785] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.314087] env[61538]: INFO networking_nsxv3.common.synchronization [req-abc39ded-3e5d-4e5d-9aae-534aa17c1993 req-a54b51e9-f1ca-4367-93a6-68cb9e29d777 service nova] Enqueued Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_rules [ 722.314087] env[61538]: INFO networking_nsxv3.common.synchronization [req-abc39ded-3e5d-4e5d-9aae-534aa17c1993 req-a54b51e9-f1ca-4367-93a6-68cb9e29d777 service nova] Enqueued Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 722.314087] env[61538]: INFO networking_nsxv3.common.synchronization [req-abc39ded-3e5d-4e5d-9aae-534aa17c1993 req-a54b51e9-f1ca-4367-93a6-68cb9e29d777 service nova] Enqueued Resource ID: 44c7a5f7-291c-4f82-ab36-b2612b504432 with Priority: HIGHEST for action port [ 722.314087] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_rules [ 722.314087] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 722.314087] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c7a5f7-291c-4f82-ab36-b2612b504432 with Priority: HIGHEST for action port [ 722.314087] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.314087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.314087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.314823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.315066] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.317846] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.317846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.317846] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-44c7a5f7-291c-4f82-ab36-b2612b504432 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.317846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44c7a5f7-291c-4f82-ab36-b2612b504432" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.317846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44c7a5f7-291c-4f82-ab36-b2612b504432" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.318291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44c7a5f7-291c-4f82-ab36-b2612b504432" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.318488] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44c7a5f7-291c-4f82-ab36-b2612b504432',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.620427] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.620597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.620648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.620925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.621018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.621097] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc is going to be updated. [ 722.651240] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.651386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.651451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.651643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.651786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.660838] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: IN_PROGRESS for 2s [ 722.674645] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: SUCCESS [ 722.674803] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d deletion is rescheduled due to dependency. [ 722.674890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.675045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.675263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.675473] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.675606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.675664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.675798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.675879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.675975] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.759591] env[61538]: INFO networking_nsxv3.common.synchronization [req-3ce298f7-599b-43db-8883-0277390bc956 req-8f4609c2-d204-49db-bc5e-0fb9a393077d tempest-SecurityGroupRulesTestJSON-258852506 tempest-SecurityGroupRulesTestJSON-258852506-project-member] Enqueued Resource ID: c8667762-4fe8-4b6b-9732-5ee5420bbfe3 with Priority: HIGHEST for action security_group_rules [ 722.760154] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8667762-4fe8-4b6b-9732-5ee5420bbfe3 with Priority: HIGHEST for action security_group_rules [ 722.760482] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.760617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.760670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.760922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.761315] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8667762-4fe8-4b6b-9732-5ee5420bbfe3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.825641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.825641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.825641] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44c7a5f7-291c-4f82-ab36-b2612b504432 with status ACTIVE [ 722.825641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.825641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.825641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.825641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.825641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.825641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.825641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.825641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.825641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.825641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.825641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.826438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.826438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.826438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.826438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.826438] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44c7a5f7-291c-4f82-ab36-b2612b504432 is going to be updated. [ 722.849726] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.849969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.850105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.850380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.850732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.850732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44c7a5f7-291c-4f82-ab36-b2612b504432" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.931218] env[61538]: INFO networking_nsxv3.common.synchronization [req-5be6e364-7c4e-4253-bdf4-0a0bd5af65eb req-413aa52e-48d2-4258-834e-1e8d6dee159e tempest-ServerExternalEventsTest-31429800 tempest-ServerExternalEventsTest-31429800-project-member] Enqueued Resource ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b with Priority: HIGHEST for action security_group_members [ 722.931571] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b with Priority: HIGHEST for action security_group_members [ 722.931867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.932038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.932094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.932326] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.932502] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.932605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.932666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.932816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.932898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.932988] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c2a68f3-1e90-484c-934f-cd67fcc8be6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.178029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.286904] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.287203] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.287203] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.287355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.287468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.288027] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8667762-4fe8-4b6b-9732-5ee5420bbfe3 already deleted. [ 723.288027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.436553] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.436756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.436828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.437125] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.437238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.437495] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.437607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.439018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.439018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.439018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.439018] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b already deleted. [ 723.439018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.450562] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.450562] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.450562] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.450973] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.451016] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.452961] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.453705] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.454064] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.454356] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.454629] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.454792] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.454942] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.455101] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.455255] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.455726] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.455950] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.481414] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.481753] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.481930] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.482227] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.482560] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-041534e2-0ec0-43ea-84f9-d0cfdec6808c taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.482796] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-041534e2-0ec0-43ea-84f9-d0cfdec6808c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.482959] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-041534e2-0ec0-43ea-84f9-d0cfdec6808c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.483405] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-041534e2-0ec0-43ea-84f9-d0cfdec6808c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.483660] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('041534e2-0ec0-43ea-84f9-d0cfdec6808c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.683037] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.751634] env[61538]: INFO networking_nsxv3.common.synchronization [req-1f66a486-1d60-405e-9db6-3e9776222442 req-a65c0281-6c97-4132-a06b-a65756f5172b tempest-SecurityGroupRulesTestJSON-258852506 tempest-SecurityGroupRulesTestJSON-258852506-project-member] Enqueued Resource ID: c8667762-4fe8-4b6b-9732-5ee5420bbfe3 with Priority: HIGHEST for action security_group_rules [ 723.752532] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8667762-4fe8-4b6b-9732-5ee5420bbfe3 with Priority: HIGHEST for action security_group_rules [ 723.752532] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.752532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.752716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.753146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.753146] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8667762-4fe8-4b6b-9732-5ee5420bbfe3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.990640] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.990640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.990640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.990640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.990640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.990640] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 041534e2-0ec0-43ea-84f9-d0cfdec6808c not found, creating... [ 723.990640] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.990640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.990640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.990640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.991016] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.991016] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.991486] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.991486] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.991486] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.992204] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.992204] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 041534e2-0ec0-43ea-84f9-d0cfdec6808c is going to be created. [ 724.018997] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.019254] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.019382] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.019666] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.019898] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.020143] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-041534e2-0ec0-43ea-84f9-d0cfdec6808c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.184278] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.185081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.185081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.185081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.185081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.185335] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d is going to be updated. [ 724.223312] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.223465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.223572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.223909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.224029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.234292] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: IN_PROGRESS for 2s [ 724.275246] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.275428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.275501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.275715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.275809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.275900] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8667762-4fe8-4b6b-9732-5ee5420bbfe3 already deleted. [ 724.275982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.671237] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: SUCCESS [ 724.671237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.671452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.672807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.672807] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.672807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.672807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.672807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.672807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.672807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.672807] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.050146] env[61538]: INFO networking_nsxv3.common.synchronization [req-c1ad062d-7fb4-49f0-b1ad-aff3cc0f06cc req-8a4e6280-dff6-4401-8d99-af0ff3959e42 tempest-SecurityGroupRulesTestJSON-258852506 tempest-SecurityGroupRulesTestJSON-258852506-project-member] Enqueued Resource ID: c8667762-4fe8-4b6b-9732-5ee5420bbfe3 with Priority: HIGHEST for action security_group_rules [ 725.050692] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8667762-4fe8-4b6b-9732-5ee5420bbfe3 with Priority: HIGHEST for action security_group_rules [ 725.051014] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.051395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.051395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.051395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.052172] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8667762-4fe8-4b6b-9732-5ee5420bbfe3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.181020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.181020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.181020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.181020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.181020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.182098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.182098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.182098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.182098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.182098] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.185030] env[61538]: INFO networking_nsxv3.common.synchronization [req-5be6e364-7c4e-4253-bdf4-0a0bd5af65eb req-beef72d5-4c6d-4b96-bcd8-823167625dfa service nova] Enqueued Resource ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b with Priority: HIGHEST for action security_group_rules [ 725.186423] env[61538]: INFO networking_nsxv3.common.synchronization [req-5be6e364-7c4e-4253-bdf4-0a0bd5af65eb req-beef72d5-4c6d-4b96-bcd8-823167625dfa service nova] Enqueued Resource ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b with Priority: HIGHEST for action security_group_members [ 725.186637] env[61538]: INFO networking_nsxv3.common.synchronization [req-5be6e364-7c4e-4253-bdf4-0a0bd5af65eb req-beef72d5-4c6d-4b96-bcd8-823167625dfa service nova] Enqueued Resource ID: 041534e2-0ec0-43ea-84f9-d0cfdec6808c with Priority: HIGHEST for action port [ 725.187994] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b with Priority: HIGHEST for action security_group_rules [ 725.187994] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b with Priority: HIGHEST for action security_group_members [ 725.187994] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041534e2-0ec0-43ea-84f9-d0cfdec6808c with Priority: HIGHEST for action port [ 725.187994] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c2a68f3-1e90-484c-934f-cd67fcc8be6b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.187994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.188192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.188391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.189454] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c2a68f3-1e90-484c-934f-cd67fcc8be6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.190314] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.190366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.193021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.193238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.193445] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.193801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.193885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.194081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.194174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.194279] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c2a68f3-1e90-484c-934f-cd67fcc8be6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.195154] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-041534e2-0ec0-43ea-84f9-d0cfdec6808c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.195234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-041534e2-0ec0-43ea-84f9-d0cfdec6808c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.195373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-041534e2-0ec0-43ea-84f9-d0cfdec6808c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.195493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-041534e2-0ec0-43ea-84f9-d0cfdec6808c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.195556] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('041534e2-0ec0-43ea-84f9-d0cfdec6808c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.576667] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.576813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.576857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.577088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.577183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.577277] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8667762-4fe8-4b6b-9732-5ee5420bbfe3 already deleted. [ 725.578139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8667762-4fe8-4b6b-9732-5ee5420bbfe3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.685063] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9f9cc04-e7d3-4a55-ba09-c74518d114dc: rpc.has_security_group_logging(os_id): False [ 725.700369] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.700369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.700369] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c2a68f3-1e90-484c-934f-cd67fcc8be6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.700369] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 041534e2-0ec0-43ea-84f9-d0cfdec6808c with status ACTIVE [ 725.700369] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.700369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.700686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.700838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.702614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.702614] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.702614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.702614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.702614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.702614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.702614] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.702614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.702614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.702614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.702614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.702614] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 041534e2-0ec0-43ea-84f9-d0cfdec6808c is going to be updated. [ 725.706489] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.706489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.706489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.707349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.707349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.707349] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.707349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.707570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.707670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.707670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.707879] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.707951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.707996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.708162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.708592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.708592] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.708592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.708592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.708808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.708808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.709072] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc is going to be updated. [ 725.726079] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.726442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.726442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.726619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.726679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.726860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-041534e2-0ec0-43ea-84f9-d0cfdec6808c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.794214] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.794397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.794479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.794760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.794924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.841294] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: IN_PROGRESS for 2s [ 726.057849] env[61538]: INFO networking_nsxv3.common.synchronization [req-ef5fcf5a-fc4d-4f25-b398-085d860beda8 req-55bcccbd-148e-4112-9e11-d43ccf560be1 tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 726.057849] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 726.057849] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.057849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.057849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.057849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.057849] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.057849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.057849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.057849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.057849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.057849] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.203875] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c2a68f3-1e90-484c-934f-cd67fcc8be6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.250764] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: SUCCESS [ 726.250764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.251321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.251417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.251735] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.251926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.252046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.252294] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.252426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.252566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.252717] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.563180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.563180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.563180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.563180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.563180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.563180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.563180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.563180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.563180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.563180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.563180] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25706118-e879-4cb5-be84-a8ab078e932e already deleted. [ 726.563180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.709843] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.709843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.709843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.709843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.709843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.709843] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b is going to be created. [ 726.737631] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.737922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.737922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.738441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.738441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.751088] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b in Status: UNINITIALIZED for 2s [ 726.758824] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.758824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.758824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.758824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.758824] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.758824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.758824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.758824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.758824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.759488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.759759] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.759971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.760307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.760584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.760843] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.762474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.762474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.762474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.762474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.762474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.762474] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.066859] env[61538]: INFO networking_nsxv3.common.synchronization [None req-6f79a9a4-2884-4433-a589-d5ffb6d70dcd None None] Enqueued Resource ID: 81fdcf66-2122-4dcf-bcae-66d88becfff3 with Priority: HIGHEST for action port [ 727.066859] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81fdcf66-2122-4dcf-bcae-66d88becfff3 with Priority: HIGHEST for action port [ 727.066859] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-81fdcf66-2122-4dcf-bcae-66d88becfff3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.066859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81fdcf66-2122-4dcf-bcae-66d88becfff3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.066859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81fdcf66-2122-4dcf-bcae-66d88becfff3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.068362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81fdcf66-2122-4dcf-bcae-66d88becfff3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.068639] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81fdcf66-2122-4dcf-bcae-66d88becfff3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.265332] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1447a613-37bb-4237-a379-2b84dc1ad40d: rpc.has_security_group_logging(os_id): False [ 727.285332] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.285332] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.285332] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.285332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.285963] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.285963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.285963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.285963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.286588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.287016] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d is going to be updated. [ 727.371901] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.374046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.374046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.374046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.374046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.391538] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: IN_PROGRESS for 2s [ 727.511718] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-579 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.512516] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-579" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.514893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-579" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.514893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-579" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.514893] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.514893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.514893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.514893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.514893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.514893] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.514893] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.514893] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.514893] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.515610] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.516843] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.517182] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.543780] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.545923] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 727.545923] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.545923] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-579" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.546287] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-2b9f3635-8a28-4d33-be62-134aabc38027 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.546542] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.546696] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.547079] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.548509] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9f3635-8a28-4d33-be62-134aabc38027',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.572146] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81fdcf66-2122-4dcf-bcae-66d88becfff3 [ 727.572146] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.572146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.572146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.572146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.572146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.572146] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81fdcf66-2122-4dcf-bcae-66d88becfff3 already deleted. [ 727.572146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81fdcf66-2122-4dcf-bcae-66d88becfff3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.860114] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: SUCCESS [ 727.860114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.051121] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.051368] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.051516] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.051921] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.051998] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.052264] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 2b9f3635-8a28-4d33-be62-134aabc38027 not found, creating... [ 728.052568] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.053103] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.053103] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.053103] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.053391] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.053704] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.053815] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.053887] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.054133] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.054271] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.054438] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 2b9f3635-8a28-4d33-be62-134aabc38027 is going to be created. [ 728.076245] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.077303] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.077462] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.077913] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.078176] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.078535] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.762343] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b in Status: SUCCESS [ 728.762654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.762718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.763950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.763950] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.763950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.763950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.763950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.763950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.763950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.763950] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c2a68f3-1e90-484c-934f-cd67fcc8be6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.263934] env[61538]: INFO networking_nsxv3.common.synchronization [None req-00660ea7-6ea7-4d21-8d2e-49a3fc44d47a None None] Enqueued Resource ID: e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7 with Priority: HIGHEST for action port [ 729.264611] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7 with Priority: HIGHEST for action port [ 729.265362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.265362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.265362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.265884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.266050] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.267362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.267588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.267906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.268178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.268431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.268656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.268862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.268981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.269151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.269433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.269624] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.269827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.269965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.270367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.270861] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.271065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.271183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.271386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.271520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.271656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.272038] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c2a68f3-1e90-484c-934f-cd67fcc8be6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.404515] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1580bca9-e2cb-4318-a766-d9efd008c6ae None None] Enqueued Resource ID: d079fd71-2e29-4cdd-bd3d-58773222f123 with Priority: HIGHEST for action port [ 729.405269] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d079fd71-2e29-4cdd-bd3d-58773222f123 with Priority: HIGHEST for action port [ 729.405723] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d079fd71-2e29-4cdd-bd3d-58773222f123 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.405908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d079fd71-2e29-4cdd-bd3d-58773222f123" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.406034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d079fd71-2e29-4cdd-bd3d-58773222f123" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.406354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d079fd71-2e29-4cdd-bd3d-58773222f123" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.406545] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d079fd71-2e29-4cdd-bd3d-58773222f123',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.408574] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: SUCCESS [ 729.409150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.777707] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7 [ 729.777707] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.777707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.777707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.777707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.777707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.777707] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7 already deleted. [ 729.777707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4fa1c25-8c63-44de-abb3-f5cdcc6f73e7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.777707] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c2a68f3-1e90-484c-934f-cd67fcc8be6b: rpc.has_security_group_logging(os_id): False [ 729.801027] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.801027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.801027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.801027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.801027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.802999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.803237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.803342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.803683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.804396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.804959] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.805306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.805746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.805959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.806080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.806295] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.806394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.806456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.807120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.808171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.808171] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b is going to be created. [ 729.879021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.879021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.879021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.879021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.882018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.891949] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b in Status: IN_PROGRESS for 2s [ 729.911022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d079fd71-2e29-4cdd-bd3d-58773222f123 [ 729.911022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.911269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.911269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.911412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.911498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.911607] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d079fd71-2e29-4cdd-bd3d-58773222f123 already deleted. [ 729.911687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d079fd71-2e29-4cdd-bd3d-58773222f123" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.020292] env[61538]: INFO networking_nsxv3.common.synchronization [req-ef5fcf5a-fc4d-4f25-b398-085d860beda8 req-17a4dd54-4323-4469-b689-bb5f534236e1 service nova] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 730.020292] env[61538]: INFO networking_nsxv3.common.synchronization [req-ef5fcf5a-fc4d-4f25-b398-085d860beda8 req-17a4dd54-4323-4469-b689-bb5f534236e1 service nova] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 730.020292] env[61538]: INFO networking_nsxv3.common.synchronization [req-ef5fcf5a-fc4d-4f25-b398-085d860beda8 req-17a4dd54-4323-4469-b689-bb5f534236e1 service nova] Enqueued Resource ID: 2b9f3635-8a28-4d33-be62-134aabc38027 with Priority: HIGHEST for action port [ 730.020292] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 730.020292] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 730.020292] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b9f3635-8a28-4d33-be62-134aabc38027 with Priority: HIGHEST for action port [ 730.020292] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.020292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.020292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.020292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.020292] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.022015] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.022015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.022015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.022015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.022191] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.022244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.022346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.022445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.022530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.023414] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.023490] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b9f3635-8a28-4d33-be62-134aabc38027 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.023564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.023600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.023746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.023816] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9f3635-8a28-4d33-be62-134aabc38027',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.525951] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.527602] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.527602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.531817] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b9f3635-8a28-4d33-be62-134aabc38027 with status ACTIVE [ 730.532062] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.532197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.532263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.532496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.532582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.532759] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.532862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.532920] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.533151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.533243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.536348] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.536559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.536654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.536827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.537296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.537579] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b9f3635-8a28-4d33-be62-134aabc38027 is going to be updated. [ 730.563600] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.563600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.563600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.563600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.563600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.564806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.990995] env[61538]: INFO networking_nsxv3.common.synchronization [None req-b4711cfc-8f47-47f0-8064-c98541efeac2 None None] Enqueued Resource ID: 4b07faf5-0154-449d-850a-e497a98c0ff3 with Priority: HIGHEST for action port [ 730.991462] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b07faf5-0154-449d-850a-e497a98c0ff3 with Priority: HIGHEST for action port [ 730.991669] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b07faf5-0154-449d-850a-e497a98c0ff3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.991669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b07faf5-0154-449d-850a-e497a98c0ff3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.991854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b07faf5-0154-449d-850a-e497a98c0ff3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.992222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b07faf5-0154-449d-850a-e497a98c0ff3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.993404] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b07faf5-0154-449d-850a-e497a98c0ff3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.031862] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.228515] env[61538]: INFO networking_nsxv3.common.synchronization [req-b0fe4336-85e3-4877-853b-0879f2c52963 req-2fed211b-7550-4187-8a4b-3c9c3568b1b7 tempest-MultipleCreateTestJSON-1583574743 tempest-MultipleCreateTestJSON-1583574743-project-member] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 731.228515] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 731.228515] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.228515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.228515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.228515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.228515] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.228515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.228515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.228515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.228515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.228515] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.496710] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b07faf5-0154-449d-850a-e497a98c0ff3 [ 731.496710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.496710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.496710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.496881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.496881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.497090] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b07faf5-0154-449d-850a-e497a98c0ff3 already deleted. [ 731.497090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b07faf5-0154-449d-850a-e497a98c0ff3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.536388] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.536388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.536388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.536388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.536696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.536696] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25706118-e879-4cb5-be84-a8ab078e932e is going to be created. [ 731.563703] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.563836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.563909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.564662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.564662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.579171] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: UNINITIALIZED for 2s [ 731.730581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.731307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.731307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.731307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.731307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.731307] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.731568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.731568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.731638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.731672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.731774] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 already deleted. [ 731.731826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.790963] env[61538]: INFO networking_nsxv3.common.synchronization [None req-3a4cf02a-36ca-4d8c-aee4-be232c04547f None None] Enqueued Resource ID: e6df89dd-ffca-4e27-873b-403b5a4d3af7 with Priority: HIGHEST for action port [ 731.791264] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6df89dd-ffca-4e27-873b-403b5a4d3af7 with Priority: HIGHEST for action port [ 731.792345] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6df89dd-ffca-4e27-873b-403b5a4d3af7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.792844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6df89dd-ffca-4e27-873b-403b5a4d3af7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.792844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6df89dd-ffca-4e27-873b-403b5a4d3af7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.792844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6df89dd-ffca-4e27-873b-403b5a4d3af7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.792959] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6df89dd-ffca-4e27-873b-403b5a4d3af7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.904069] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b in Status: SUCCESS [ 731.904281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.950885] env[61538]: INFO networking_nsxv3.common.synchronization [None req-78592aba-ae58-4b92-8afd-7a74422bb460 None None] Enqueued Resource ID: ffae738a-3a0e-4dde-a582-7bb4c8cfac61 with Priority: HIGHEST for action port [ 731.951151] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffae738a-3a0e-4dde-a582-7bb4c8cfac61 with Priority: HIGHEST for action port [ 731.951712] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffae738a-3a0e-4dde-a582-7bb4c8cfac61 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.951841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffae738a-3a0e-4dde-a582-7bb4c8cfac61" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.951907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffae738a-3a0e-4dde-a582-7bb4c8cfac61" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.952258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffae738a-3a0e-4dde-a582-7bb4c8cfac61" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.952353] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffae738a-3a0e-4dde-a582-7bb4c8cfac61',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.991420] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-306 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.991728] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.991728] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.992066] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.992315] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.992480] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.992596] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.992811] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.992957] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.994092] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.994092] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.994092] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.994092] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.994092] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.994092] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.994092] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.014957] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.015206] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.015363] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.015629] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.016052] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.016332] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.016533] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.016979] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.017234] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c7a22d0-b4ff-436d-bb77-faa9c853dd35',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.295988] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6df89dd-ffca-4e27-873b-403b5a4d3af7 [ 732.296477] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.297565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.297565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.297565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.297565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.298059] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6df89dd-ffca-4e27-873b-403b5a4d3af7 already deleted. [ 732.298059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6df89dd-ffca-4e27-873b-403b5a4d3af7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.457016] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffae738a-3a0e-4dde-a582-7bb4c8cfac61 [ 732.457385] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.457600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.457683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.457969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.458086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.458191] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffae738a-3a0e-4dde-a582-7bb4c8cfac61 already deleted. [ 732.458288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffae738a-3a0e-4dde-a582-7bb4c8cfac61" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.525077] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.525077] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.525077] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.525077] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.525077] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.525077] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 0c7a22d0-b4ff-436d-bb77-faa9c853dd35 not found, creating... [ 732.525077] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.525077] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.525077] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.525077] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.525077] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.526042] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.526042] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.526042] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.526042] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.526435] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.526435] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 0c7a22d0-b4ff-436d-bb77-faa9c853dd35 is going to be created. [ 732.551228] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.559343] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.559343] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.559343] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.560945] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.560945] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.575760] env[61538]: INFO networking_nsxv3.common.synchronization [None req-27c545ea-3683-4de2-9bd3-8c00c97fb206 None None] Enqueued Resource ID: 9d5d90ad-65f0-4914-b6d0-f1b9364e3afc with Priority: HIGHEST for action port [ 732.576539] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d90ad-65f0-4914-b6d0-f1b9364e3afc with Priority: HIGHEST for action port [ 732.579266] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d5d90ad-65f0-4914-b6d0-f1b9364e3afc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.580613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d5d90ad-65f0-4914-b6d0-f1b9364e3afc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.580613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d5d90ad-65f0-4914-b6d0-f1b9364e3afc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.580613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d5d90ad-65f0-4914-b6d0-f1b9364e3afc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.581567] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d5d90ad-65f0-4914-b6d0-f1b9364e3afc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.867681] env[61538]: INFO networking_nsxv3.common.synchronization [None req-d6e54f0b-94e9-447a-a079-d8da9859a72a tempest-ServersV294TestFqdnHostnames-598528889 tempest-ServersV294TestFqdnHostnames-598528889-project-member] Enqueued Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_rules [ 732.868861] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_rules [ 732.869366] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ded91e44-4a5f-4d2c-a527-86674f66c321 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.869503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.869571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.869835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.869919] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.003040] env[61538]: INFO networking_nsxv3.common.synchronization [None req-18218530-deb9-4d9a-b018-630a483ff91f tempest-ServersV294TestFqdnHostnames-598528889 tempest-ServersV294TestFqdnHostnames-598528889-project-member] Enqueued Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_rules [ 733.003040] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_rules [ 733.003040] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ded91e44-4a5f-4d2c-a527-86674f66c321 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.003453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.083600] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d5d90ad-65f0-4914-b6d0-f1b9364e3afc [ 733.083849] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.083996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.084060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.084273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.084400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.084441] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d5d90ad-65f0-4914-b6d0-f1b9364e3afc already deleted. [ 733.084524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d5d90ad-65f0-4914-b6d0-f1b9364e3afc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.392332] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.399215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.399215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.399215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.399215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.399215] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ded91e44-4a5f-4d2c-a527-86674f66c321 already deleted. [ 733.399215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.406191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.406384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.412842] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.599504] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: SUCCESS [ 733.599504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.599504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.599504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.599504] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.599504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.599504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.599504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.599504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.599504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.599504] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.661462] env[61538]: INFO networking_nsxv3.common.synchronization [req-b0fe4336-85e3-4877-853b-0879f2c52963 req-5168b77f-fdef-4d15-85a8-f27cbfe4e567 service nova] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_rules [ 733.661633] env[61538]: INFO networking_nsxv3.common.synchronization [req-b0fe4336-85e3-4877-853b-0879f2c52963 req-5168b77f-fdef-4d15-85a8-f27cbfe4e567 service nova] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 733.661767] env[61538]: INFO networking_nsxv3.common.synchronization [req-b0fe4336-85e3-4877-853b-0879f2c52963 req-5168b77f-fdef-4d15-85a8-f27cbfe4e567 service nova] Enqueued Resource ID: 0c7a22d0-b4ff-436d-bb77-faa9c853dd35 with Priority: HIGHEST for action port [ 733.662030] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_rules [ 733.662381] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 733.662381] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c7a22d0-b4ff-436d-bb77-faa9c853dd35 with Priority: HIGHEST for action port [ 733.663054] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.663218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.663248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.663578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.663669] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.664574] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.664687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.664752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.664933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.665090] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.665182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.665236] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.665385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.665467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.665596] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.666414] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.666581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.666661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.666756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.666828] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c7a22d0-b4ff-436d-bb77-faa9c853dd35',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.937408] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.937408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.937408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.937408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.937408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.937408] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ded91e44-4a5f-4d2c-a527-86674f66c321 already deleted. [ 733.937408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.104279] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.172408] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.174742] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.174742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.176371] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c7a22d0-b4ff-436d-bb77-faa9c853dd35 with status ACTIVE [ 734.178712] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.178712] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.178712] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.178712] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c7a22d0-b4ff-436d-bb77-faa9c853dd35 is going to be updated. [ 734.211132] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.211132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.211132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.211132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.211355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.211519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c7a22d0-b4ff-436d-bb77-faa9c853dd35" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.607294] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25706118-e879-4cb5-be84-a8ab078e932e: rpc.has_security_group_logging(os_id): False [ 734.629111] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.629111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.629111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.629111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.629111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.629111] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.629111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.629111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.629111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.629111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.629111] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25706118-e879-4cb5-be84-a8ab078e932e is going to be created. [ 734.678159] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.707017] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.707017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.707017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.707017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.707017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.722786] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: IN_PROGRESS for 2s [ 735.180501] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.181009] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.181009] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.181073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.181145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.181252] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be created. [ 735.214026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.214026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.214026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.214026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.214026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.228503] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: UNINITIALIZED for 2s [ 735.394638] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1c727a0c-070d-4401-89a1-3763f1b8ffe4 None None] Enqueued Resource ID: e3cd9519-dace-4b5b-b311-8519c6840e13 with Priority: HIGHEST for action port [ 735.394638] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cd9519-dace-4b5b-b311-8519c6840e13 with Priority: HIGHEST for action port [ 735.395814] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3cd9519-dace-4b5b-b311-8519c6840e13 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.396577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3cd9519-dace-4b5b-b311-8519c6840e13" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.396577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3cd9519-dace-4b5b-b311-8519c6840e13" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.396679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3cd9519-dace-4b5b-b311-8519c6840e13" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.396739] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3cd9519-dace-4b5b-b311-8519c6840e13',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.900528] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3cd9519-dace-4b5b-b311-8519c6840e13 [ 735.900528] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.900528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.900528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.900528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.900528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.900528] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3cd9519-dace-4b5b-b311-8519c6840e13 already deleted. [ 735.900528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3cd9519-dace-4b5b-b311-8519c6840e13" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.740434] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: SUCCESS [ 736.741091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.791236] env[61538]: INFO networking_nsxv3.common.synchronization [req-b0fe4336-85e3-4877-853b-0879f2c52963 req-e742d5d1-96ff-4dda-b477-f6e7a2c394e3 tempest-MultipleCreateTestJSON-1583574743 tempest-MultipleCreateTestJSON-1583574743-project-member] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 736.791992] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 736.792430] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.792935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.243158] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 737.243158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.243158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.243158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.243158] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.243158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.243158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.243158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.243158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.243158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.243158] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.244486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.244657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.244811] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.244912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.245035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.245128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.246784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.246784] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.462750] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-306 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.463085] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.463342] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.463826] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.467718] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.467718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.468102] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.468288] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.468523] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.468766] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.469011] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.469011] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.469172] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.471015] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.471015] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.471015] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.490418] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.490695] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 737.491114] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.491114] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.491466] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-832392a5-d47c-47ed-9aaa-c361e28e2418 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.491902] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-832392a5-d47c-47ed-9aaa-c361e28e2418" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.491902] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-832392a5-d47c-47ed-9aaa-c361e28e2418" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.492257] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-832392a5-d47c-47ed-9aaa-c361e28e2418" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.492510] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('832392a5-d47c-47ed-9aaa-c361e28e2418',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.748031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.748031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.748536] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.996634] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.997179] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.997179] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.997693] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.997693] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.997851] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 832392a5-d47c-47ed-9aaa-c361e28e2418 not found, creating... [ 737.998128] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.998291] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.998407] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.998637] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.998777] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.999077] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.999240] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.999346] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.999551] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.999688] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.999825] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 832392a5-d47c-47ed-9aaa-c361e28e2418 is going to be created. [ 738.022589] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.023026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.023026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.023228] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.023461] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.023729] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-832392a5-d47c-47ed-9aaa-c361e28e2418" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.252756] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.757094] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.757389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.757389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.757709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.757806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.757908] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 738.788046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.788210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.788282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.788508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.788671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.799299] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 739.701384] env[61538]: INFO networking_nsxv3.common.synchronization [req-b0fe4336-85e3-4877-853b-0879f2c52963 req-02e45f34-4bcf-4d3e-a9d2-d771e7e10e30 service nova] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_rules [ 739.701538] env[61538]: INFO networking_nsxv3.common.synchronization [req-b0fe4336-85e3-4877-853b-0879f2c52963 req-02e45f34-4bcf-4d3e-a9d2-d771e7e10e30 service nova] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 739.701750] env[61538]: INFO networking_nsxv3.common.synchronization [req-b0fe4336-85e3-4877-853b-0879f2c52963 req-02e45f34-4bcf-4d3e-a9d2-d771e7e10e30 service nova] Enqueued Resource ID: 832392a5-d47c-47ed-9aaa-c361e28e2418 with Priority: HIGHEST for action port [ 739.702072] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_rules [ 739.702241] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 739.702401] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832392a5-d47c-47ed-9aaa-c361e28e2418 with Priority: HIGHEST for action port [ 739.702988] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.703143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.703692] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.703692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.703692] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-832392a5-d47c-47ed-9aaa-c361e28e2418 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.703856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-832392a5-d47c-47ed-9aaa-c361e28e2418" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.703856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-832392a5-d47c-47ed-9aaa-c361e28e2418" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.703987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-832392a5-d47c-47ed-9aaa-c361e28e2418" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.704079] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('832392a5-d47c-47ed-9aaa-c361e28e2418',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.791026] env[61538]: INFO networking_nsxv3.common.synchronization [req-43583ea1-278f-48fa-b51d-b2263b84eca5 req-d2abd346-7cc7-4b54-b534-563954ff001f tempest-DeleteServersAdminTestJSON-1595240936 tempest-DeleteServersAdminTestJSON-1595240936-project-member] Enqueued Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 739.791512] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGHEST for action security_group_members [ 739.791839] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.791976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.793780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.794050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.797265] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.797265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.797265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.797265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.797265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.797265] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.208937] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 832392a5-d47c-47ed-9aaa-c361e28e2418 with status ACTIVE [ 740.208937] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.208937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.208937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.208937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.208937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.208937] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.208937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.208937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.208937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.209222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.209583] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.209583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.209583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.209719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.209772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.209874] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 832392a5-d47c-47ed-9aaa-c361e28e2418 is going to be updated. [ 740.241949] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.242933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.242933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.242933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.242933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.242933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-832392a5-d47c-47ed-9aaa-c361e28e2418" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.299553] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.299749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.299813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.300152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.300223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.300384] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.300487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.300553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.300728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.300811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.300920] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d is going to be updated. [ 740.342915] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.343075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.343147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.343427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.343588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.358782] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: IN_PROGRESS for 2s [ 740.811738] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 740.812017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.812162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.812392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.812592] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.812714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.812779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.812931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.813027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.813115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.813280] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.814923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.814923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.814923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.814923] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.814923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.814923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.814923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.815182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.815268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.815355] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.816469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.816711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.816913] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.817031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.817093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.817250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.817335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.817432] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.323411] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 794d6c9f-f896-426d-a29e-0a532c759616: rpc.has_security_group_logging(os_id): False [ 741.325389] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.340705] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.343276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.343369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.344157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.344157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.344157] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.344351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.344351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.344473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.344554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.344756] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.344858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.344909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.345073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.345154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.345399] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.345470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.345470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.345700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.345780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.345872] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be created. [ 741.420871] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.421044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.421126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.421350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.421633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.436712] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 741.826135] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.025593] env[61538]: INFO networking_nsxv3.common.synchronization [None req-921a4ac8-ce5f-4014-bafe-5743989dc3f0 None None] Enqueued Resource ID: b610be8d-f588-4ebe-b6db-bf7e0c49f632 with Priority: HIGHEST for action port [ 742.027264] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b610be8d-f588-4ebe-b6db-bf7e0c49f632 with Priority: HIGHEST for action port [ 742.027264] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b610be8d-f588-4ebe-b6db-bf7e0c49f632 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.027264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b610be8d-f588-4ebe-b6db-bf7e0c49f632" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.027264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b610be8d-f588-4ebe-b6db-bf7e0c49f632" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.027264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b610be8d-f588-4ebe-b6db-bf7e0c49f632" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.027264] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b610be8d-f588-4ebe-b6db-bf7e0c49f632',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.169980] env[61538]: INFO networking_nsxv3.common.synchronization [req-6628d89d-5925-4596-b5ed-b5c6babdf028 req-1d8d5c09-786c-44e4-8d11-fee7c9104902 tempest-ServerExternalEventsTest-31429800 tempest-ServerExternalEventsTest-31429800-project-member] Enqueued Resource ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b with Priority: HIGHEST for action security_group_members [ 742.170501] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b with Priority: HIGHEST for action security_group_members [ 742.170817] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.170939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.171015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.171221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.172365] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.172478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.172566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.172694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.172759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.172853] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c2a68f3-1e90-484c-934f-cd67fcc8be6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.329458] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.329642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.329717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.332129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.332129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.332129] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 742.364870] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.364870] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.364870] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.364870] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.365093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.379128] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1447a613-37bb-4237-a379-2b84dc1ad40d in Status: SUCCESS [ 742.379128] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d deletion is rescheduled due to dependency. [ 742.379128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.379128] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 742.484507] env[61538]: INFO networking_nsxv3.common.synchronization [req-113fb754-a72a-4f91-b482-a18c046be08f req-850c6ca9-1ca4-492c-9d03-e7a2ba9e89c9 tempest-ServerRescueTestJSON-824602145 tempest-ServerRescueTestJSON-824602145-project-member] Enqueued Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 742.488260] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 742.488260] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.488260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.488260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.488260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.488260] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.488260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.488260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.488260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.488260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.488260] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.530096] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b610be8d-f588-4ebe-b6db-bf7e0c49f632 [ 742.530096] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.530096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.530096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.530096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.530469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.530469] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b610be8d-f588-4ebe-b6db-bf7e0c49f632 already deleted. [ 742.530469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b610be8d-f588-4ebe-b6db-bf7e0c49f632" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.680140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.680140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.680140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.680140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.680140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.680140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.680140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.680140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.680140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.680140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.680140] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b is going to be updated. [ 742.723333] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.726120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.726120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.726120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.726120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.752909] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b in Status: IN_PROGRESS for 2s [ 742.990544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.990829] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.990829] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.990999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.991104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.991315] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.991431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.991483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.991636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.991714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.991801] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 already deleted. [ 742.991900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.429559] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.429763] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-740" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.429893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-740" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.431360] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-740" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.431930] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.431930] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.432116] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.432268] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.432459] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.432688] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.432825] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.432937] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.433059] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.433171] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.433288] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.433426] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.461793] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 743.461793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.461793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.462594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.463088] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.467245] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.467529] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.467736] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.469785] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-740" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.469785] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-af3b8dc6-019b-4076-b26a-f6eaaa30a979 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.469785] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-af3b8dc6-019b-4076-b26a-f6eaaa30a979" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.469785] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-af3b8dc6-019b-4076-b26a-f6eaaa30a979" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.469785] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-af3b8dc6-019b-4076-b26a-f6eaaa30a979" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.469785] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af3b8dc6-019b-4076-b26a-f6eaaa30a979',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.931408] env[61538]: INFO networking_nsxv3.common.synchronization [req-cda259a4-88d4-4524-9994-e4c1c57a72c2 req-7355bb8a-6a0e-451b-b7f7-755b4de40c14 tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 743.932187] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 743.932535] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.932650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.932720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.932939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.933202] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.933321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.933373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.933519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.933628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.933726] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.966697] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.966830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.971388] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.971622] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.971749] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.972190] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.972350] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.972507] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port af3b8dc6-019b-4076-b26a-f6eaaa30a979 not found, creating... [ 743.972778] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.972942] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.973074] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.973304] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.973444] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.973730] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.973888] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.974073] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.974334] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.974594] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.974785] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: af3b8dc6-019b-4076-b26a-f6eaaa30a979 is going to be created. [ 743.997913] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.998234] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.998267] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.998631] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.998759] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.998995] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-af3b8dc6-019b-4076-b26a-f6eaaa30a979" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.120989] env[61538]: INFO networking_nsxv3.common.synchronization [req-776f39b6-d89b-478c-b75c-d5e91de97b61 req-059d07ca-617f-4c61-8a57-9080919016b6 tempest-ServersAdminNegativeTestJSON-1477357562 tempest-ServersAdminNegativeTestJSON-1477357562-project-member] Enqueued Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 744.121727] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 744.122148] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.122314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.122411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.122667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.122870] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.123011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.123105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.123765] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.123765] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.123765] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.392126] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 744.392360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.392544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.392793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.392998] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.393127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.393355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.393355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.393454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.393542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.393639] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.425969] env[61538]: INFO networking_nsxv3.common.synchronization [None req-a33cf97e-d003-4f6e-a790-98889fa559bf None None] Enqueued Resource ID: 97863651-857d-461a-8e0c-179f721393a4 with Priority: HIGHEST for action port [ 744.426567] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97863651-857d-461a-8e0c-179f721393a4 with Priority: HIGHEST for action port [ 744.426945] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-97863651-857d-461a-8e0c-179f721393a4 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.427171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97863651-857d-461a-8e0c-179f721393a4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.427247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97863651-857d-461a-8e0c-179f721393a4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.427537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97863651-857d-461a-8e0c-179f721393a4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.427594] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97863651-857d-461a-8e0c-179f721393a4',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.435354] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.436051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.436051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.436051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.436051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.436251] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.436345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.436822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.436822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.436822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.436822] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 744.480033] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.480209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.480277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.480507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.482035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.491429] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 744.630723] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.766194] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b in Status: SUCCESS [ 744.766403] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c2a68f3-1e90-484c-934f-cd67fcc8be6b deletion is rescheduled due to dependency. [ 744.766669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c2a68f3-1e90-484c-934f-cd67fcc8be6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.896436] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.896608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.896698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.896981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.897234] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.897377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.897446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.897631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.897741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.897905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.898064] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.898185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.898250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.898477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.898607] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.898727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.898804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.898979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.899478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.899615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.899724] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.930652] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97863651-857d-461a-8e0c-179f721393a4 [ 744.930868] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.931122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.931122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.931300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.931395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.931490] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97863651-857d-461a-8e0c-179f721393a4 already deleted. [ 744.931587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97863651-857d-461a-8e0c-179f721393a4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.117913] env[61538]: INFO networking_nsxv3.common.synchronization [req-24b81d36-81cc-4e2e-91cd-01b289d371db req-648885dd-dec3-4bf4-87dd-dd60039b8aee tempest-VolumesAdminNegativeTest-2067435148 tempest-VolumesAdminNegativeTest-2067435148-project-member] Enqueued Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_members [ 745.120234] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_members [ 745.120234] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.120234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.120234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.120234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.120234] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.120234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.120234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.120234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.120234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.120234] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.134392] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.329400] env[61538]: INFO networking_nsxv3.common.synchronization [req-113fb754-a72a-4f91-b482-a18c046be08f req-a1c214c6-7718-44ad-9008-804cf4c69fb3 service nova] Enqueued Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_rules [ 745.329575] env[61538]: INFO networking_nsxv3.common.synchronization [req-113fb754-a72a-4f91-b482-a18c046be08f req-a1c214c6-7718-44ad-9008-804cf4c69fb3 service nova] Enqueued Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 745.329717] env[61538]: INFO networking_nsxv3.common.synchronization [req-113fb754-a72a-4f91-b482-a18c046be08f req-a1c214c6-7718-44ad-9008-804cf4c69fb3 service nova] Enqueued Resource ID: af3b8dc6-019b-4076-b26a-f6eaaa30a979 with Priority: HIGHEST for action port [ 745.329952] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_rules [ 745.330527] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 745.330527] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af3b8dc6-019b-4076-b26a-f6eaaa30a979 with Priority: HIGHEST for action port [ 745.330753] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.334240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.334324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.334606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.334805] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.335937] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.335937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.335937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.336171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.336226] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.337045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.337045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.337045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.337045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.337045] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.343286] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-af3b8dc6-019b-4076-b26a-f6eaaa30a979 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.343462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af3b8dc6-019b-4076-b26a-f6eaaa30a979" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.343587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af3b8dc6-019b-4076-b26a-f6eaaa30a979" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.343831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af3b8dc6-019b-4076-b26a-f6eaaa30a979" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.343918] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af3b8dc6-019b-4076-b26a-f6eaaa30a979',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.402472] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 794d6c9f-f896-426d-a29e-0a532c759616: rpc.has_security_group_logging(os_id): False [ 745.427797] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.427797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.428191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.428191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.428298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.430139] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.430139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.430139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.430139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.430139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.430139] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.430139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.430139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.430484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.430615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.431217] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.431217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.431217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.431217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.431590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.431745] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 745.539825] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.539959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.540038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.540264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.540405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.556704] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 745.622754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.622890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.622890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.625869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.625869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.625869] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.625869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.625869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.625869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.625869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.625869] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e already deleted. [ 745.625869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.639418] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.639418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.639418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.639418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.639418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.639418] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc is going to be updated. [ 745.702380] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.702380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.702380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.702380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.702380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.714288] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: IN_PROGRESS for 2s [ 745.730331] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.730522] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.730643] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.730976] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.731248] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.733268] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.733268] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.733268] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.733268] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.733268] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.733268] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.733268] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.733268] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.733268] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.733268] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.733510] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.755801] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.755974] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.756124] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.756306] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.756631] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-7e56c9b7-f0cb-41e5-b513-077c74cba86c taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.756832] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-7e56c9b7-f0cb-41e5-b513-077c74cba86c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.756962] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-7e56c9b7-f0cb-41e5-b513-077c74cba86c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.757309] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-7e56c9b7-f0cb-41e5-b513-077c74cba86c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.757448] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e56c9b7-f0cb-41e5-b513-077c74cba86c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.848429] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.848429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.848429] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.848429] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af3b8dc6-019b-4076-b26a-f6eaaa30a979 with status ACTIVE [ 745.848578] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.848956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.848956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.848956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.849101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.849217] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.849314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.849374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.849563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.849647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.849867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.849962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.850034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.850208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.850283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.850379] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af3b8dc6-019b-4076-b26a-f6eaaa30a979 is going to be updated. [ 745.874918] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.875089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.875167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.875365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.875505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.875720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af3b8dc6-019b-4076-b26a-f6eaaa30a979" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.260364] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.260364] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.260863] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.260863] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.262020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.262020] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 7e56c9b7-f0cb-41e5-b513-077c74cba86c not found, creating... [ 746.262020] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.262020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.262020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.262314] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.262314] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.262616] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.262868] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.263106] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.263312] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.263869] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.263869] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 7e56c9b7-f0cb-41e5-b513-077c74cba86c is going to be created. [ 746.299101] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.300095] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.300095] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.300095] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.300095] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.300272] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-7e56c9b7-f0cb-41e5-b513-077c74cba86c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.352806] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.504170] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 746.504170] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b deletion is rescheduled due to dependency. [ 746.504170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.856395] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.856395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.856395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.856395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.856395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.856395] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 is going to be created. [ 746.888859] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.889412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.890155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.890155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.890155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.900833] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: UNINITIALIZED for 2s [ 747.389996] env[61538]: INFO networking_nsxv3.common.synchronization [req-24b81d36-81cc-4e2e-91cd-01b289d371db req-2e4ae193-f282-4fb0-82bb-400338ffc776 service nova] Enqueued Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_rules [ 747.390244] env[61538]: INFO networking_nsxv3.common.synchronization [req-24b81d36-81cc-4e2e-91cd-01b289d371db req-2e4ae193-f282-4fb0-82bb-400338ffc776 service nova] Enqueued Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_members [ 747.390358] env[61538]: INFO networking_nsxv3.common.synchronization [req-24b81d36-81cc-4e2e-91cd-01b289d371db req-2e4ae193-f282-4fb0-82bb-400338ffc776 service nova] Enqueued Resource ID: 7e56c9b7-f0cb-41e5-b513-077c74cba86c with Priority: HIGHEST for action port [ 747.390879] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_rules [ 747.391520] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_members [ 747.394177] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e56c9b7-f0cb-41e5-b513-077c74cba86c with Priority: HIGHEST for action port [ 747.394343] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.394531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.395446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.395446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.395446] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.396869] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.397518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.397518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.397829] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.401264] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.401414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.401484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.401683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.401775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.401891] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.406040] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e56c9b7-f0cb-41e5-b513-077c74cba86c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.406040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e56c9b7-f0cb-41e5-b513-077c74cba86c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.406040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e56c9b7-f0cb-41e5-b513-077c74cba86c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.406040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e56c9b7-f0cb-41e5-b513-077c74cba86c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.406040] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e56c9b7-f0cb-41e5-b513-077c74cba86c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.571845] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 747.572100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.726035] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: SUCCESS [ 747.726204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.908086] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.908301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.908549] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.909514] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e56c9b7-f0cb-41e5-b513-077c74cba86c with status ACTIVE [ 747.909713] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.909835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.909902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.910138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.910227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.910407] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.910495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.910577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.910714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.910796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.910974] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.911218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.911289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.911439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.911517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.911606] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e56c9b7-f0cb-41e5-b513-077c74cba86c is going to be updated. [ 747.937150] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.937150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.937150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.937150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.937150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.937150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e56c9b7-f0cb-41e5-b513-077c74cba86c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.416765] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.912703] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: SUCCESS [ 748.912943] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.913143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.913371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.913573] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.913687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.913753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.913911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.913992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.914092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.914253] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.922103] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.922679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.922766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.922973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.923760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.923760] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e is going to be created. [ 748.952431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.952600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.952674] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.952922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.953119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.964143] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e in Status: UNINITIALIZED for 2s [ 749.422433] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.422705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.422705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.422882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.423068] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.423173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.423235] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.423386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.423473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.423589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.423749] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.423851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.423912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.424066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.424202] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.424291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.424369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.424505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.424587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.424657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.424768] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.926735] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8feb07e8-1e39-437e-8497-dad4b8420d11: rpc.has_security_group_logging(os_id): False [ 749.943991] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.944138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.944219] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.944477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.944591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.944819] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.944986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.945114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.945365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.945499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.945808] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.945922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.945987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.946232] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.946291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.946514] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.946649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.946649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.946802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.946931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.947052] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 is going to be created. [ 750.004461] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.004614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.004688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.004917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.005110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.019044] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: IN_PROGRESS for 2s [ 750.990451] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e in Status: SUCCESS [ 750.990752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.991564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.991564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.991769] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.991999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.992200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.992464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.993093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.993093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.993093] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.161669] env[61538]: INFO networking_nsxv3.common.synchronization [req-b1e1d906-4564-4cfb-b8d5-81addcdcabdf req-e0798788-c18e-4046-a6ed-4f848d39d390 tempest-FloatingIPsAssociationTestJSON-741219197 tempest-FloatingIPsAssociationTestJSON-741219197-project-member] Enqueued Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 751.162225] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 751.163152] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.163152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.163152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.163152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.163781] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.163900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.164010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.164238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.164366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.164507] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.496061] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.667930] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.726552] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.726805] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-733" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.727204] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-733" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.727331] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-733" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.729786] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.729786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.729786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.729786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.729786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.729786] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.729786] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.729786] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.729786] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.729786] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.729786] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.729786] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.749210] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.749405] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 751.749559] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.749774] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-733" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.750160] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.750364] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.750493] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.750882] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.755115] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc5f1dc-e836-46e6-8584-5c4d98ba5241',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.999684] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87950fcb-64a8-4442-9ae9-01d668ddee9e: rpc.has_security_group_logging(os_id): False [ 752.018893] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.019053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.019126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.019352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.019448] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.019687] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.019787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.019851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.019997] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.020091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.020180] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e is going to be created. [ 752.034193] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: SUCCESS [ 752.034405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.088025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.088025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.088025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.088025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.088025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.102764] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e in Status: IN_PROGRESS for 2s [ 752.169281] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.258877] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.259122] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.259251] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.259543] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.259710] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.259848] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 9cc5f1dc-e836-46e6-8584-5c4d98ba5241 not found, creating... [ 752.260165] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.260455] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.260455] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.260661] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.260801] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.261106] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.261258] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.261374] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.261582] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.261715] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.261858] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 9cc5f1dc-e836-46e6-8584-5c4d98ba5241 is going to be created. [ 752.284353] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.284353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.284353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.284353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.284353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.284353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.360585] env[61538]: INFO networking_nsxv3.common.synchronization [req-de67c4ae-ff04-4f32-8770-3937feaad8fc req-abddf364-1c95-4dbe-be15-de9a007b52c6 tempest-MultipleCreateTestJSON-1583574743 tempest-MultipleCreateTestJSON-1583574743-project-member] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 752.362309] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 752.363038] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.363197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.363267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.363517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.363704] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.363824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.363887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.364087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.364222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.364328] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.369233] env[61538]: INFO networking_nsxv3.common.synchronization [None req-a9717070-db6e-4dee-bf1e-1be98d2e3682 None None] Enqueued Resource ID: 0d2bb3ce-6a8e-46eb-903e-b24808a61535 with Priority: HIGHEST for action port [ 752.369944] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d2bb3ce-6a8e-46eb-903e-b24808a61535 with Priority: HIGHEST for action port [ 752.370690] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d2bb3ce-6a8e-46eb-903e-b24808a61535 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.370843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d2bb3ce-6a8e-46eb-903e-b24808a61535" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.370908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d2bb3ce-6a8e-46eb-903e-b24808a61535" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.371858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d2bb3ce-6a8e-46eb-903e-b24808a61535" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.371956] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d2bb3ce-6a8e-46eb-903e-b24808a61535',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.473997] env[61538]: INFO networking_nsxv3.common.synchronization [req-ab422579-5fc8-4b80-94b5-b2698b77f238 req-bdcc651b-f1a4-4ed1-aa3a-b8aedef4c5de tempest-MultipleCreateTestJSON-1583574743 tempest-MultipleCreateTestJSON-1583574743-project-member] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 752.474104] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 752.474585] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.474687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.675271] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.675750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.675750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.675750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.675886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.676023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad is going to be updated. [ 752.716201] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.716324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.716397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.716625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.716784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.728168] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: IN_PROGRESS for 2s [ 752.867275] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.878998] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d2bb3ce-6a8e-46eb-903e-b24808a61535 [ 752.880876] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.881103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.881185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.881420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.881515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.881613] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d2bb3ce-6a8e-46eb-903e-b24808a61535 already deleted. [ 752.881721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d2bb3ce-6a8e-46eb-903e-b24808a61535" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.376289] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.497112] env[61538]: INFO networking_nsxv3.common.synchronization [req-b1e1d906-4564-4cfb-b8d5-81addcdcabdf req-a158cbbf-6160-4be7-9802-ddfe1ea6aa12 service nova] Enqueued Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_rules [ 753.497296] env[61538]: INFO networking_nsxv3.common.synchronization [req-b1e1d906-4564-4cfb-b8d5-81addcdcabdf req-a158cbbf-6160-4be7-9802-ddfe1ea6aa12 service nova] Enqueued Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 753.497428] env[61538]: INFO networking_nsxv3.common.synchronization [req-b1e1d906-4564-4cfb-b8d5-81addcdcabdf req-a158cbbf-6160-4be7-9802-ddfe1ea6aa12 service nova] Enqueued Resource ID: 9cc5f1dc-e836-46e6-8584-5c4d98ba5241 with Priority: HIGHEST for action port [ 753.497953] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_rules [ 753.500621] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 753.501617] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc5f1dc-e836-46e6-8584-5c4d98ba5241 with Priority: HIGHEST for action port [ 753.502450] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.503253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.503407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.503703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.503872] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.505784] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.506024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.506544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.506793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.506941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.507453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.507725] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc5f1dc-e836-46e6-8584-5c4d98ba5241',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.880028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.880028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.880028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.880456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.881924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.881924] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 753.911306] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.911456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.911523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.911760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.912488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.927849] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 754.010301] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.010487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.010729] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cc5f1dc-e836-46e6-8584-5c4d98ba5241 with status ACTIVE [ 754.010933] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.011075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.011144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.011374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.011467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.011658] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.011769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.011830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.011986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.012085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.012279] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.012376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.012445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.012587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.012697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.012783] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cc5f1dc-e836-46e6-8584-5c4d98ba5241 is going to be updated. [ 754.033965] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.034126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.034194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.034428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.034598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.034846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cc5f1dc-e836-46e6-8584-5c4d98ba5241" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.117753] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e in Status: SUCCESS [ 754.117753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.626369] env[61538]: INFO networking_nsxv3.common.synchronization [None req-47ee45de-986a-4285-bfe4-8ae46bbf79de None None] Enqueued Resource ID: e77811bc-00a2-49da-a266-b1289d2e302a with Priority: HIGHEST for action port [ 754.627000] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e77811bc-00a2-49da-a266-b1289d2e302a with Priority: HIGHEST for action port [ 754.627276] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e77811bc-00a2-49da-a266-b1289d2e302a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.627448] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e77811bc-00a2-49da-a266-b1289d2e302a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.627521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e77811bc-00a2-49da-a266-b1289d2e302a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.627804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e77811bc-00a2-49da-a266-b1289d2e302a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.627957] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e77811bc-00a2-49da-a266-b1289d2e302a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.738103] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: SUCCESS [ 754.738373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.738451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.738650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.738834] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.738944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.739018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.739167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.739242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.739342] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.133944] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e77811bc-00a2-49da-a266-b1289d2e302a [ 755.134219] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.134360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.134429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.134641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.134732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.134826] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e77811bc-00a2-49da-a266-b1289d2e302a already deleted. [ 755.134909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e77811bc-00a2-49da-a266-b1289d2e302a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.241308] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.745754] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.941113] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 755.941113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.941113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.941113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.941113] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.941113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.941113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.941113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.941113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.941113] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.244034] env[61538]: INFO networking_nsxv3.common.synchronization [req-97bcde41-d337-4b74-877a-241b6dc8050c req-66f31041-8618-4e9c-aec9-41e032a93673 tempest-ServerMetadataNegativeTestJSON-2088309652 tempest-ServerMetadataNegativeTestJSON-2088309652-project-member] Enqueued Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGHEST for action security_group_members [ 756.244560] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGHEST for action security_group_members [ 756.244914] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac90853-4d65-407f-8da6-b4b200fba904 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.246512] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.246672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.246933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.247135] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.247243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.247305] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.251457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.251457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.251457] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac90853-4d65-407f-8da6-b4b200fba904',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.251457] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.251457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.251457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.251457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.251457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.251457] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad is going to be updated. [ 756.280999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.283859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.283859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.283859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.283859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.292280] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: IN_PROGRESS for 2s [ 756.447421] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.447421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.447421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.447421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.447421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.447421] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.447421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.447421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.447421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.447421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.447421] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 756.474328] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.474328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.474328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.474328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.474328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.480149] env[61538]: INFO networking_nsxv3.common.synchronization [None req-147162ab-e65d-4238-92fa-3159f9ae3355 None None] Enqueued Resource ID: b47d3c97-826b-41bc-b2a9-d16e6671b065 with Priority: HIGHEST for action port [ 756.480149] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47d3c97-826b-41bc-b2a9-d16e6671b065 with Priority: HIGHEST for action port [ 756.480149] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b47d3c97-826b-41bc-b2a9-d16e6671b065 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.480149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b47d3c97-826b-41bc-b2a9-d16e6671b065" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.480149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b47d3c97-826b-41bc-b2a9-d16e6671b065" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.480149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b47d3c97-826b-41bc-b2a9-d16e6671b065" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.480149] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47d3c97-826b-41bc-b2a9-d16e6671b065',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.482463] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 756.754935] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.754935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.754935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.754935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.754935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.754935] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.754935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.754935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.754935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.754935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.754935] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac90853-4d65-407f-8da6-b4b200fba904 already deleted. [ 756.754935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.982319] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b47d3c97-826b-41bc-b2a9-d16e6671b065 [ 756.982551] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.982707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.982738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.982947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.983051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.983151] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b47d3c97-826b-41bc-b2a9-d16e6671b065 already deleted. [ 756.983252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b47d3c97-826b-41bc-b2a9-d16e6671b065" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.333854] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.333854] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-422" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.333854] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-422" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.333854] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-422" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.334605] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.334605] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.334605] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.334794] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.334794] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.335187] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.335187] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.335283] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.335376] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.335488] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.335592] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.335804] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.357059] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.357191] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.357250] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.357423] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-422" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.357750] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.357927] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.358066] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.358415] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.358571] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20ad03f5-59d2-4cd0-b053-4d59cc02f11b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.862488] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.862786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.862832] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.863125] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.863281] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.863435] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 20ad03f5-59d2-4cd0-b053-4d59cc02f11b not found, creating... [ 757.863696] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.864110] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.864110] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.864215] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.864301] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.864974] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.864974] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.864974] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.865380] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.865569] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.865778] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 20ad03f5-59d2-4cd0-b053-4d59cc02f11b is going to be created. [ 757.888927] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.889396] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.889902] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.890292] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.893322] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.893574] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.304266] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: SUCCESS [ 758.304266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.304266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.304266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.304266] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.304266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.304266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.304557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.304557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.304557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.304642] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.495324] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 758.495324] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 deletion is rescheduled due to dependency. [ 758.495324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.807218] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.807409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.807483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.807665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.807832] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.807926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.807983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.808148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.808236] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.808325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.808468] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.808558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.808611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.808752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.808890] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.808980] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.809053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.809185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.809260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.809340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.809427] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.026853] env[61538]: INFO networking_nsxv3.common.synchronization [req-97bcde41-d337-4b74-877a-241b6dc8050c req-77617342-3f84-4ff7-a4bf-84dcaae967dd service nova] Enqueued Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGHEST for action security_group_rules [ 759.027253] env[61538]: INFO networking_nsxv3.common.synchronization [req-97bcde41-d337-4b74-877a-241b6dc8050c req-77617342-3f84-4ff7-a4bf-84dcaae967dd service nova] Enqueued Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGHEST for action security_group_members [ 759.027253] env[61538]: INFO networking_nsxv3.common.synchronization [req-97bcde41-d337-4b74-877a-241b6dc8050c req-77617342-3f84-4ff7-a4bf-84dcaae967dd service nova] Enqueued Resource ID: 20ad03f5-59d2-4cd0-b053-4d59cc02f11b with Priority: HIGHEST for action port [ 759.027753] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGHEST for action security_group_rules [ 759.027865] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGHEST for action security_group_members [ 759.028384] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ad03f5-59d2-4cd0-b053-4d59cc02f11b with Priority: HIGHEST for action port [ 759.031201] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dac90853-4d65-407f-8da6-b4b200fba904 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.032081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.032359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.032436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.032534] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dac90853-4d65-407f-8da6-b4b200fba904',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.033462] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac90853-4d65-407f-8da6-b4b200fba904 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.033675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.033675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.034054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.034054] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.034134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.034164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.034286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.034370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.034458] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac90853-4d65-407f-8da6-b4b200fba904',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.043064] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.043064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.043064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.043064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.043064] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20ad03f5-59d2-4cd0-b053-4d59cc02f11b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.312568] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3a6fa36-755e-48b1-ab72-10594e3701ad: rpc.has_security_group_logging(os_id): False [ 759.334985] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.334985] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.334985] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.334985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.335682] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.335682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.335682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.335682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.335682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.335845] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad is going to be updated. [ 759.409326] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.409908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.409908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.409908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.410068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.426037] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: IN_PROGRESS for 2s [ 759.486104] env[61538]: INFO networking_nsxv3.common.synchronization [None req-10f1c835-7299-4d90-894d-291abb861873 tempest-MigrationsAdminTest-1836932771 tempest-MigrationsAdminTest-1836932771-project-member] Enqueued Resource ID: 4f898fa0-9326-439f-a65a-3e98829d955f with Priority: HIGHEST for action security_group_rules [ 759.486104] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f898fa0-9326-439f-a65a-3e98829d955f with Priority: HIGHEST for action security_group_rules [ 759.486388] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f898fa0-9326-439f-a65a-3e98829d955f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.486616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f898fa0-9326-439f-a65a-3e98829d955f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.486616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f898fa0-9326-439f-a65a-3e98829d955f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.486939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f898fa0-9326-439f-a65a-3e98829d955f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.491221] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f898fa0-9326-439f-a65a-3e98829d955f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.543841] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac90853-4d65-407f-8da6-b4b200fba904 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.543995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.544401] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dac90853-4d65-407f-8da6-b4b200fba904',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.546095] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20ad03f5-59d2-4cd0-b053-4d59cc02f11b with status ACTIVE [ 759.546095] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.546095] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.546095] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.546525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.546525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.546666] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.546666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.546763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.547915] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.547961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.548312] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.548443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.548506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.548699] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.548786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.548889] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20ad03f5-59d2-4cd0-b053-4d59cc02f11b is going to be updated. [ 759.578037] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.578037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.578037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.578292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.578402] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.578577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20ad03f5-59d2-4cd0-b053-4d59cc02f11b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.630669] env[61538]: INFO networking_nsxv3.common.synchronization [None req-9809fda7-928b-4f0d-b627-e258d68d83e9 tempest-MigrationsAdminTest-1836932771 tempest-MigrationsAdminTest-1836932771-project-member] Enqueued Resource ID: 4f898fa0-9326-439f-a65a-3e98829d955f with Priority: HIGHEST for action security_group_rules [ 759.631465] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f898fa0-9326-439f-a65a-3e98829d955f with Priority: HIGHEST for action security_group_rules [ 759.631778] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f898fa0-9326-439f-a65a-3e98829d955f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.631881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f898fa0-9326-439f-a65a-3e98829d955f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.013355] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.013565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.013565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.013792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.013968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.013968] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f898fa0-9326-439f-a65a-3e98829d955f already deleted. [ 760.014081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f898fa0-9326-439f-a65a-3e98829d955f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.014254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f898fa0-9326-439f-a65a-3e98829d955f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.014398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f898fa0-9326-439f-a65a-3e98829d955f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.014482] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f898fa0-9326-439f-a65a-3e98829d955f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.054410] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dac90853-4d65-407f-8da6-b4b200fba904',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.534684] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.534895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.534895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.535117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.535214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.535312] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f898fa0-9326-439f-a65a-3e98829d955f already deleted. [ 760.535393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f898fa0-9326-439f-a65a-3e98829d955f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.557122] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.557337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.557431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.557801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.557801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.557946] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac90853-4d65-407f-8da6-b4b200fba904 is going to be created. [ 760.582910] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.583049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.583049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.583255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.583423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.596246] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac90853-4d65-407f-8da6-b4b200fba904 in Status: UNINITIALIZED for 2s [ 761.442570] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: SUCCESS [ 761.442938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.040535] env[61538]: INFO networking_nsxv3.common.synchronization [req-acf0562a-fdd0-4412-9166-0da8feace1bc req-5d33f695-07e2-4862-a9ed-240a9fe1a568 tempest-ServerMetadataTestJSON-447458016 tempest-ServerMetadataTestJSON-447458016-project-member] Enqueued Resource ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e with Priority: HIGHEST for action security_group_members [ 762.042208] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e with Priority: HIGHEST for action security_group_members [ 762.042364] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-27cb37c1-ffde-4f82-835b-823e403e1b9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.042495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.042563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.042822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.042988] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.043172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.043244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.043611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.043611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.043611] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27cb37c1-ffde-4f82-835b-823e403e1b9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.549535] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.549842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.549878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.550161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.550318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.550544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.550653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.550756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.551102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.551202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.551293] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e already deleted. [ 762.551376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.586769] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-914 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.587105] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-914" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.587354] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-914" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.587819] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-914" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.588259] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.588514] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.588720] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.589022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.589205] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.589399] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.589514] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.589623] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.589741] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.589917] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.590122] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.590309] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.610282] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac90853-4d65-407f-8da6-b4b200fba904 in Status: SUCCESS [ 762.610650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.610757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.610986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.611470] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.611579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.611685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.611827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.611926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.612038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.612134] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dac90853-4d65-407f-8da6-b4b200fba904',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.617523] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.617681] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.617827] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.618749] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-914" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.618749] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-25571e3a-347e-4c8e-82cc-0f636f3bca8d taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.618749] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-25571e3a-347e-4c8e-82cc-0f636f3bca8d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.618749] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-25571e3a-347e-4c8e-82cc-0f636f3bca8d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.619184] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-25571e3a-347e-4c8e-82cc-0f636f3bca8d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.619184] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25571e3a-347e-4c8e-82cc-0f636f3bca8d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.114442] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac90853-4d65-407f-8da6-b4b200fba904 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.114652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.114652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.114858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.115039] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.115880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.116145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.116349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.116454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.116554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.116731] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac90853-4d65-407f-8da6-b4b200fba904 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.116971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.116971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.117127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.117286] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.117286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.117399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.117461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.117533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.117619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.117707] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dac90853-4d65-407f-8da6-b4b200fba904',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.122138] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.122138] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.122138] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.122138] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.122138] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.122138] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 25571e3a-347e-4c8e-82cc-0f636f3bca8d not found, creating... [ 763.122435] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.122514] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.122634] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.122846] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.122985] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.123314] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.123522] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.123648] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.123857] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.123994] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.124172] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 25571e3a-347e-4c8e-82cc-0f636f3bca8d is going to be created. [ 763.148022] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.148022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.148022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.148022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.148022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.148022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-25571e3a-347e-4c8e-82cc-0f636f3bca8d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.620230] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dac90853-4d65-407f-8da6-b4b200fba904: rpc.has_security_group_logging(os_id): False [ 763.640919] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.641084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.641388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.641547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.641668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.642055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.642055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.642185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.642237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.642314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.642490] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.642585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.642641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.642782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.642856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.643051] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.643136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.643195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.643332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.643406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.643490] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dac90853-4d65-407f-8da6-b4b200fba904 is going to be created. [ 763.705269] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.705458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.705544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.705928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.706240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.732065] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dac90853-4d65-407f-8da6-b4b200fba904 in Status: IN_PROGRESS for 2s [ 764.633467] env[61538]: INFO networking_nsxv3.common.synchronization [req-acf0562a-fdd0-4412-9166-0da8feace1bc req-442bbe85-a6e4-4986-ab81-2010661c0c33 service nova] Enqueued Resource ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e with Priority: HIGHEST for action security_group_rules [ 764.633772] env[61538]: INFO networking_nsxv3.common.synchronization [req-acf0562a-fdd0-4412-9166-0da8feace1bc req-442bbe85-a6e4-4986-ab81-2010661c0c33 service nova] Enqueued Resource ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e with Priority: HIGHEST for action security_group_members [ 764.633808] env[61538]: INFO networking_nsxv3.common.synchronization [req-acf0562a-fdd0-4412-9166-0da8feace1bc req-442bbe85-a6e4-4986-ab81-2010661c0c33 service nova] Enqueued Resource ID: 25571e3a-347e-4c8e-82cc-0f636f3bca8d with Priority: HIGHEST for action port [ 764.634373] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e with Priority: HIGHEST for action security_group_rules [ 764.634521] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e with Priority: HIGHEST for action security_group_members [ 764.634620] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25571e3a-347e-4c8e-82cc-0f636f3bca8d with Priority: HIGHEST for action port [ 764.635406] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27cb37c1-ffde-4f82-835b-823e403e1b9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.635826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.636026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.636328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.636435] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27cb37c1-ffde-4f82-835b-823e403e1b9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.637405] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-27cb37c1-ffde-4f82-835b-823e403e1b9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.637517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.637583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.637762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.637919] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.638119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.638119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.638223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.638303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.638403] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27cb37c1-ffde-4f82-835b-823e403e1b9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.643021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-25571e3a-347e-4c8e-82cc-0f636f3bca8d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.643021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25571e3a-347e-4c8e-82cc-0f636f3bca8d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.643021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25571e3a-347e-4c8e-82cc-0f636f3bca8d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.643021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25571e3a-347e-4c8e-82cc-0f636f3bca8d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.643021] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25571e3a-347e-4c8e-82cc-0f636f3bca8d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.937709] env[61538]: INFO networking_nsxv3.common.synchronization [req-0091d272-9f11-4eb0-90b5-ed2562a3d3ae req-872e86e4-49b0-4d26-8b5b-5be8628eba50 tempest-ServersAdminTestJSON-1231961305 tempest-ServersAdminTestJSON-1231961305-project-member] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 764.938259] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 764.938566] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.938700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.940007] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.940324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.940504] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.940616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.940681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.940891] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.940991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.941108] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.142114] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-27cb37c1-ffde-4f82-835b-823e403e1b9e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.142261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.142467] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27cb37c1-ffde-4f82-835b-823e403e1b9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.143540] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25571e3a-347e-4c8e-82cc-0f636f3bca8d with status ACTIVE [ 765.143761] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.143891] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.143976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.144212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.144306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.144479] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.144580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.144641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.144788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.144866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.145218] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.145338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.145401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.145546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.145622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.145740] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25571e3a-347e-4c8e-82cc-0f636f3bca8d is going to be updated. [ 765.169545] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.169701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.169792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.170041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.170186] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.170340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25571e3a-347e-4c8e-82cc-0f636f3bca8d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.443480] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.443480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.443939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.443939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.444089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.444314] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.444422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.444517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.444771] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.444912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.445024] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 already deleted. [ 765.445136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.627122] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.627122] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.627122] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.627694] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.627954] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.628188] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.628586] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.628586] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.628743] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.628960] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 765.629061] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 765.629182] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 765.629287] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 765.629404] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 765.629511] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 765.629773] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 765.647222] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27cb37c1-ffde-4f82-835b-823e403e1b9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.649603] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 765.649767] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 765.649906] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 765.650150] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.650510] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-d289bc06-c77a-460a-b15d-e94dcfb3ff53 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.650687] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-d289bc06-c77a-460a-b15d-e94dcfb3ff53" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.650810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-d289bc06-c77a-460a-b15d-e94dcfb3ff53" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.651161] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-d289bc06-c77a-460a-b15d-e94dcfb3ff53" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.651294] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d289bc06-c77a-460a-b15d-e94dcfb3ff53',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.745020] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dac90853-4d65-407f-8da6-b4b200fba904 in Status: SUCCESS [ 765.745346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.156025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.156025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.156025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.156025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.156025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.156025] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e is going to be created. [ 766.156025] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.156025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.156025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.156025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.156633] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.156913] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port d289bc06-c77a-460a-b15d-e94dcfb3ff53 not found, creating... [ 766.157469] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.157777] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.157987] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.158420] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.158786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.159421] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.159716] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.160259] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.160566] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.160812] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.161055] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: d289bc06-c77a-460a-b15d-e94dcfb3ff53 is going to be created. [ 766.206024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.206024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.206024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.206024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.206024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.206928] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.207334] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.207570] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.207938] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.208331] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.209467] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-d289bc06-c77a-460a-b15d-e94dcfb3ff53" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.228651] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e in Status: UNINITIALIZED for 2s [ 767.617315] env[61538]: INFO networking_nsxv3.common.synchronization [req-0091d272-9f11-4eb0-90b5-ed2562a3d3ae req-5d7c3c6d-71f0-4dea-b4fa-7c956b6f15cd service nova] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_rules [ 767.617631] env[61538]: INFO networking_nsxv3.common.synchronization [req-0091d272-9f11-4eb0-90b5-ed2562a3d3ae req-5d7c3c6d-71f0-4dea-b4fa-7c956b6f15cd service nova] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 767.617719] env[61538]: INFO networking_nsxv3.common.synchronization [req-0091d272-9f11-4eb0-90b5-ed2562a3d3ae req-5d7c3c6d-71f0-4dea-b4fa-7c956b6f15cd service nova] Enqueued Resource ID: d289bc06-c77a-460a-b15d-e94dcfb3ff53 with Priority: HIGHEST for action port [ 767.618285] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_rules [ 767.618420] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 767.618513] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d289bc06-c77a-460a-b15d-e94dcfb3ff53 with Priority: HIGHEST for action port [ 767.618775] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.619515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.619515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.619515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.619515] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.621951] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.622071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.622160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.623635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.623635] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.623635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.623635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.623635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.623635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.623635] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.624775] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d289bc06-c77a-460a-b15d-e94dcfb3ff53 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.624890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d289bc06-c77a-460a-b15d-e94dcfb3ff53" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.624961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d289bc06-c77a-460a-b15d-e94dcfb3ff53" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.625209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d289bc06-c77a-460a-b15d-e94dcfb3ff53" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.625325] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d289bc06-c77a-460a-b15d-e94dcfb3ff53',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.857791] env[61538]: INFO networking_nsxv3.common.synchronization [req-ec9b4d15-ac5d-48a9-b0de-ea2e16c7e1bc req-d1b7504c-ae48-44b5-9dee-d9497dba0b3c tempest-ServerActionsV293TestJSON-1352632226 tempest-ServerActionsV293TestJSON-1352632226-project-member] Enqueued Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_members [ 767.861020] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_members [ 767.861020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-365fd2af-187a-43da-9017-8bc6e06e1910 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.861020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.861020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.861020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.861020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.861020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.861020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.861020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.861020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.861020] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.127668] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.127977] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.128421] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.130668] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d289bc06-c77a-460a-b15d-e94dcfb3ff53 with status ACTIVE [ 768.130668] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.130668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.130668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.130668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.130668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.130668] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.130668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.132079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.132548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.132971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.135503] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.135503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.135503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.135503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.135503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.135503] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d289bc06-c77a-460a-b15d-e94dcfb3ff53 is going to be updated. [ 768.157034] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.157034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.157034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.157034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.157034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.157034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d289bc06-c77a-460a-b15d-e94dcfb3ff53" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.245472] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e in Status: SUCCESS [ 768.245472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.245472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.245472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.245650] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.245650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.245750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.245989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.245989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.246091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.246179] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27cb37c1-ffde-4f82-835b-823e403e1b9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.361423] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.361631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.361884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.361968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.362110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.362319] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.362415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.362473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.362613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.362685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.362765] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365fd2af-187a-43da-9017-8bc6e06e1910 already deleted. [ 768.362838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.531809] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-248 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.531966] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-248" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.532081] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-248" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.532432] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-248" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.532804] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.532922] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.532995] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.533266] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.533473] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.534214] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.535056] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.535056] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.535056] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.535056] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.535056] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.535056] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.556160] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.556359] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.556496] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.556684] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-248" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.557116] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-1d429567-3342-4107-b5f0-2596a7002020 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.557300] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-1d429567-3342-4107-b5f0-2596a7002020" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.557418] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-1d429567-3342-4107-b5f0-2596a7002020" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.557742] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-1d429567-3342-4107-b5f0-2596a7002020" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.557939] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d429567-3342-4107-b5f0-2596a7002020',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.635961] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.748540] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-27cb37c1-ffde-4f82-835b-823e403e1b9e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.748750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.748750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.749287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.749287] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.749287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.749490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.749490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.749577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.749636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.749842] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-27cb37c1-ffde-4f82-835b-823e403e1b9e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.749994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.750102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.750222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.750365] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.750471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.750557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.750640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.750713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.750780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.750862] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27cb37c1-ffde-4f82-835b-823e403e1b9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.061344] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.061699] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.061932] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.062373] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.063033] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.063033] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 1d429567-3342-4107-b5f0-2596a7002020 not found, creating... [ 769.063653] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.063653] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.063777] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.064114] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.064364] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.064705] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.064868] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.064989] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.065240] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.065377] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.065517] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 1d429567-3342-4107-b5f0-2596a7002020 is going to be created. [ 769.086571] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.086797] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.086906] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.087256] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.087489] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.087708] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-1d429567-3342-4107-b5f0-2596a7002020" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.138544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.138733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.138863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.139084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.139280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.139442] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be created. [ 769.169153] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.169227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.169227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.169467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.169633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.192047] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: UNINITIALIZED for 2s [ 769.255045] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27cb37c1-ffde-4f82-835b-823e403e1b9e: rpc.has_security_group_logging(os_id): False [ 769.274917] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.275330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.275436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.275690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.275809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.276441] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.276441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.276441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.276441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.276668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.276668] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.276767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.276860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.278400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.280483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.280483] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.280483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.280483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.280483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.280483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.280483] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e is going to be created. [ 769.360058] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.360282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.360353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.360541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.360722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.379158] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e in Status: IN_PROGRESS for 2s [ 770.338357] env[61538]: INFO networking_nsxv3.common.synchronization [req-ec9b4d15-ac5d-48a9-b0de-ea2e16c7e1bc req-1db6cfb5-2eb0-4a75-adbe-491e0604e8c2 service nova] Enqueued Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_rules [ 770.338575] env[61538]: INFO networking_nsxv3.common.synchronization [req-ec9b4d15-ac5d-48a9-b0de-ea2e16c7e1bc req-1db6cfb5-2eb0-4a75-adbe-491e0604e8c2 service nova] Enqueued Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_members [ 770.338665] env[61538]: INFO networking_nsxv3.common.synchronization [req-ec9b4d15-ac5d-48a9-b0de-ea2e16c7e1bc req-1db6cfb5-2eb0-4a75-adbe-491e0604e8c2 service nova] Enqueued Resource ID: 1d429567-3342-4107-b5f0-2596a7002020 with Priority: HIGHEST for action port [ 770.338982] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_rules [ 770.339041] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_members [ 770.339137] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d429567-3342-4107-b5f0-2596a7002020 with Priority: HIGHEST for action port [ 770.339648] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365fd2af-187a-43da-9017-8bc6e06e1910 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.339775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.339842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.340409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.340497] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.341589] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-365fd2af-187a-43da-9017-8bc6e06e1910 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.341727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.341913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.342112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.342254] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.342349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.342410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.342546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.342631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.342725] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.349024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d429567-3342-4107-b5f0-2596a7002020 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.349024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d429567-3342-4107-b5f0-2596a7002020" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.349024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d429567-3342-4107-b5f0-2596a7002020" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.349024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d429567-3342-4107-b5f0-2596a7002020" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.349024] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d429567-3342-4107-b5f0-2596a7002020',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.847641] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.847641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-365fd2af-187a-43da-9017-8bc6e06e1910 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.847641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.855029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d429567-3342-4107-b5f0-2596a7002020 with status ACTIVE [ 770.855029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.855029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.855029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.855029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.855029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d429567-3342-4107-b5f0-2596a7002020 is going to be updated. [ 770.873343] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.874770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.874770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.874770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.874770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.874770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d429567-3342-4107-b5f0-2596a7002020" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.016413] env[61538]: INFO networking_nsxv3.common.synchronization [req-57e0f798-76ca-42cc-b8df-19bce33d678d req-4e5a54c6-8d9c-4325-be3a-9317696350db tempest-ServersAdminTestJSON-1231961305 tempest-ServersAdminTestJSON-1231961305-project-member] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 771.016413] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 771.017658] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.018393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.349773] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.367077] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 771.367366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.367901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.368337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.368598] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.368768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.368956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.369172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.369324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.369555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.369555] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.370429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.371489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.371721] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.371880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.371986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.372191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.372318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.372449] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.391301] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e in Status: SUCCESS [ 771.391603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.852595] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.852805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.852805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.853132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.853332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.853506] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365fd2af-187a-43da-9017-8bc6e06e1910 is going to be created. [ 771.875283] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.875283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.875283] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.880930] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.880930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.880930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.880930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.880930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.892370] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365fd2af-187a-43da-9017-8bc6e06e1910 in Status: UNINITIALIZED for 2s [ 771.907352] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.907612] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.907756] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.908125] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.908403] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.908582] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.908732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.908964] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.909180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.909396] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.909511] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.909619] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.909728] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.909838] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.909947] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.910092] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.932788] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.933065] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 771.933250] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.933530] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.934014] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-71a8926c-7ea6-4f74-b990-81464c47f0c1 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.934264] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-71a8926c-7ea6-4f74-b990-81464c47f0c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.934631] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-71a8926c-7ea6-4f74-b990-81464c47f0c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.935200] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-71a8926c-7ea6-4f74-b990-81464c47f0c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.935391] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71a8926c-7ea6-4f74-b990-81464c47f0c1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.379068] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.441025] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.441025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.441025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.441025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.441025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.441025] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 71a8926c-7ea6-4f74-b990-81464c47f0c1 not found, creating... [ 772.441025] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.441025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.441025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.441025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.441025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.442728] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.443162] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.443460] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.443845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.444417] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.444707] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 71a8926c-7ea6-4f74-b990-81464c47f0c1 is going to be created. [ 772.474026] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.474026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.474026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.474026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.474026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.474026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-71a8926c-7ea6-4f74-b990-81464c47f0c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.881113] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.881416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.881416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.881605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.881700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.881820] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 772.925087] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.925087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.925087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.925087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.925087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.937484] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 773.638435] env[61538]: INFO networking_nsxv3.common.synchronization [req-57e0f798-76ca-42cc-b8df-19bce33d678d req-81135f97-3431-459c-9129-bf7b6be8e323 service nova] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_rules [ 773.638435] env[61538]: INFO networking_nsxv3.common.synchronization [req-57e0f798-76ca-42cc-b8df-19bce33d678d req-81135f97-3431-459c-9129-bf7b6be8e323 service nova] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 773.638687] env[61538]: INFO networking_nsxv3.common.synchronization [req-57e0f798-76ca-42cc-b8df-19bce33d678d req-81135f97-3431-459c-9129-bf7b6be8e323 service nova] Enqueued Resource ID: 71a8926c-7ea6-4f74-b990-81464c47f0c1 with Priority: HIGHEST for action port [ 773.639402] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_rules [ 773.639645] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 773.639723] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71a8926c-7ea6-4f74-b990-81464c47f0c1 with Priority: HIGHEST for action port [ 773.640082] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.640161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.640981] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.640981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.640981] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-71a8926c-7ea6-4f74-b990-81464c47f0c1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.640981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71a8926c-7ea6-4f74-b990-81464c47f0c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.640981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71a8926c-7ea6-4f74-b990-81464c47f0c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.640981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71a8926c-7ea6-4f74-b990-81464c47f0c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.641212] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71a8926c-7ea6-4f74-b990-81464c47f0c1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.906159] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365fd2af-187a-43da-9017-8bc6e06e1910 in Status: SUCCESS [ 773.906519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.906707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.906962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.907189] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.907322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.907389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.907558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.907643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.907730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.907841] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.147370] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71a8926c-7ea6-4f74-b990-81464c47f0c1 with status ACTIVE [ 774.147610] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.147749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.147814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.148048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.148742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.148997] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.149128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.149195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.149377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.149473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.149648] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.149744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.149805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.150128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.150208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.150294] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71a8926c-7ea6-4f74-b990-81464c47f0c1 is going to be updated. [ 774.178712] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.178712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.179468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71a8926c-7ea6-4f74-b990-81464c47f0c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.412213] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.916581] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 365fd2af-187a-43da-9017-8bc6e06e1910: rpc.has_security_group_logging(os_id): False [ 774.942058] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.942058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.942058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.942058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.942058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.942691] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.942959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.943145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.943455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.943659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.943911] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365fd2af-187a-43da-9017-8bc6e06e1910 is going to be created. [ 774.952599] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.955024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.955024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.955024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.955024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.955809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.955984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.956280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.956492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.956695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.956919] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.959027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.959027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.959027] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.959027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.959027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.959027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.959027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.959027] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.018408] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.018695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.018695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.018837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.019045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.038657] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365fd2af-187a-43da-9017-8bc6e06e1910 in Status: IN_PROGRESS for 2s [ 775.463560] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e4fbaf8-8019-44da-bb3b-478c3b16eb47: rpc.has_security_group_logging(os_id): False [ 775.465349] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.488580] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.488763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.488904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.489054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.489174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.489450] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.489562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.490122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.490525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.490613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.490825] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.490954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.491217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.491562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.491655] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.492033] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.492153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.492213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.492389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.492459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.492539] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be created. [ 775.582637] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.582862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.582982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.583360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.583470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.602533] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 775.738215] env[61538]: INFO networking_nsxv3.common.synchronization [req-a9f20e51-97ad-4531-b296-8559d61fcee1 req-610e8b1a-5216-480b-b31c-fa451c5a7a94 tempest-FloatingIPsAssociationTestJSON-741219197 tempest-FloatingIPsAssociationTestJSON-741219197-project-member] Enqueued Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 775.738808] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 775.741249] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.741502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.741627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.741904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.742176] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.742414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.742414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.742611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.742789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.742789] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.971100] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.249919] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.476292] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.476292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.476292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.476292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.476292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.476292] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 776.512136] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.512258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.512311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.512522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.512662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.523909] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 776.752342] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.056051] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365fd2af-187a-43da-9017-8bc6e06e1910 in Status: SUCCESS [ 777.056051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.255879] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.256106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.256180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.256424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.256513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.256613] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad is going to be updated. [ 777.290153] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.290320] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.290386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.290598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.290742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.301635] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: IN_PROGRESS for 2s [ 777.627069] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 777.627309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.627512] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.627750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.627839] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.682224] env[61538]: INFO networking_nsxv3.common.synchronization [None req-cfc10af5-3664-4b46-8456-1bfabd2a627c None None] Enqueued Resource ID: eb9a0c37-8d73-472b-8109-123322937f9d with Priority: HIGHEST for action port [ 777.682332] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb9a0c37-8d73-472b-8109-123322937f9d with Priority: HIGHEST for action port [ 777.684283] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb9a0c37-8d73-472b-8109-123322937f9d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.684421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb9a0c37-8d73-472b-8109-123322937f9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.684489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb9a0c37-8d73-472b-8109-123322937f9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.684881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb9a0c37-8d73-472b-8109-123322937f9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.684973] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb9a0c37-8d73-472b-8109-123322937f9d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.130343] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.130690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.190075] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb9a0c37-8d73-472b-8109-123322937f9d [ 778.190075] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.190075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.190075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.190075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.190075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.190075] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb9a0c37-8d73-472b-8109-123322937f9d already deleted. [ 778.190075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb9a0c37-8d73-472b-8109-123322937f9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.536576] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 4s [ 778.729591] env[61538]: INFO networking_nsxv3.common.synchronization [None req-cae377ae-a748-46d5-997a-e73b0b465663 tempest-ServerActionsTestOtherB-1077210391 tempest-ServerActionsTestOtherB-1077210391-project-member] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 778.730618] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 778.731341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.731516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.731656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.732030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.732145] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.844651] env[61538]: INFO networking_nsxv3.common.synchronization [None req-93acf9e0-f54c-4f72-9138-13aef5e4d3c6 tempest-ServerActionsTestOtherB-1077210391 tempest-ServerActionsTestOtherB-1077210391-project-member] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 778.845237] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 778.845544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.845644] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.256274] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.256274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.256274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.256274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.256274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.256274] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 already deleted. [ 779.256274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.256717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.256717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.256717] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.314650] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: SUCCESS [ 779.314796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.632956] env[61538]: INFO networking_nsxv3.common.synchronization [req-b720d4b2-29bc-4e52-8d20-187580c45ccd req-d780dcad-376c-4115-805f-e3b6051b36a2 tempest-ListImageFiltersTestJSON-574044180 tempest-ListImageFiltersTestJSON-574044180-project-member] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 779.633517] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 779.633857] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.633986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.639102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.639102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.639102] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.639102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.639102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.639102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.639102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.639102] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.779577] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.779577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.779577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.779577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.779577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.779577] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 already deleted. [ 779.779577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.087911] env[61538]: INFO networking_nsxv3.common.synchronization [None req-054bc7f9-72b6-4715-90c8-d11f79c8ec91 None None] Enqueued Resource ID: 09adb571-3675-498d-8bc6-4fffda507734 with Priority: HIGHEST for action port [ 780.088827] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09adb571-3675-498d-8bc6-4fffda507734 with Priority: HIGHEST for action port [ 780.089700] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-09adb571-3675-498d-8bc6-4fffda507734 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.089883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09adb571-3675-498d-8bc6-4fffda507734" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.090489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09adb571-3675-498d-8bc6-4fffda507734" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.090489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09adb571-3675-498d-8bc6-4fffda507734" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.090665] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09adb571-3675-498d-8bc6-4fffda507734',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.144519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.144727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.144810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.145069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.145170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.145368] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.145469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.145531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.145685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.145760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.145920] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 already deleted. [ 780.146035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.547741] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 780.548162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.548162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.548368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.548556] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.548676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.548741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.548893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.548978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.549073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.549222] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.593538] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09adb571-3675-498d-8bc6-4fffda507734 [ 780.593538] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.593538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.593538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.593873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.593873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.593873] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09adb571-3675-498d-8bc6-4fffda507734 already deleted. [ 780.593873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09adb571-3675-498d-8bc6-4fffda507734" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.734648] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.734768] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.734901] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.735203] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.735480] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.735640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.735760] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.736268] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.736475] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.736728] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.736889] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.737082] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.737257] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.737534] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.737534] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.737770] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.762172] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.762172] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.762172] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.762542] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.762666] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-f6cead7f-5ede-4097-9f73-f9849bdc96bc taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.762894] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-f6cead7f-5ede-4097-9f73-f9849bdc96bc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.763029] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-f6cead7f-5ede-4097-9f73-f9849bdc96bc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.763376] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-f6cead7f-5ede-4097-9f73-f9849bdc96bc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.763765] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6cead7f-5ede-4097-9f73-f9849bdc96bc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.987316] env[61538]: INFO networking_nsxv3.common.synchronization [req-277e2812-d2ec-470a-852c-f3c2b5eb7ad1 req-5bd84d02-01aa-4c5a-8c22-dab7f7ccb096 tempest-ServerMetadataNegativeTestJSON-2088309652 tempest-ServerMetadataNegativeTestJSON-2088309652-project-member] Enqueued Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGHEST for action security_group_members [ 780.988338] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGHEST for action security_group_members [ 780.988893] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac90853-4d65-407f-8da6-b4b200fba904 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.989085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.989205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.989660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.989660] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.989868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.989951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.990158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.990319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.990462] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac90853-4d65-407f-8da6-b4b200fba904',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.055024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.055024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.055024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.055024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.055024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.055897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.055897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.055897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.055897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.055897] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.267610] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.268159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.268159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.268354] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.268424] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.268582] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port f6cead7f-5ede-4097-9f73-f9849bdc96bc not found, creating... [ 781.268844] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.268997] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.269107] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.269324] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.269459] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.269739] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.269874] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.270023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.270293] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.270665] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.270665] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: f6cead7f-5ede-4097-9f73-f9849bdc96bc is going to be created. [ 781.300965] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.300965] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.300965] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.300965] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.300965] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.300965] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-f6cead7f-5ede-4097-9f73-f9849bdc96bc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.499589] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.499965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.499965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.500315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.500315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.500421] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.500520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.500595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.500744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.501111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.501111] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac90853-4d65-407f-8da6-b4b200fba904 is going to be updated. [ 781.533846] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.533991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.533991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.534462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.534462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.545533] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac90853-4d65-407f-8da6-b4b200fba904 in Status: IN_PROGRESS for 2s [ 781.558615] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e4fbaf8-8019-44da-bb3b-478c3b16eb47: rpc.has_security_group_logging(os_id): False [ 781.578340] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.578529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.578594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.578801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.578912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.579246] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.580290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.580290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.580290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.580290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.580290] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.580290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.580676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.580676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.580676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.580851] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.580951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.581022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.581214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.581323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.581443] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 781.651311] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.651473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.651540] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.651769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.651912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.668108] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 782.209983] env[61538]: INFO networking_nsxv3.common.synchronization [req-b720d4b2-29bc-4e52-8d20-187580c45ccd req-c0252b2e-de92-43ab-b609-d3145d2838bd service nova] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_rules [ 782.210205] env[61538]: INFO networking_nsxv3.common.synchronization [req-b720d4b2-29bc-4e52-8d20-187580c45ccd req-c0252b2e-de92-43ab-b609-d3145d2838bd service nova] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 782.210414] env[61538]: INFO networking_nsxv3.common.synchronization [req-b720d4b2-29bc-4e52-8d20-187580c45ccd req-c0252b2e-de92-43ab-b609-d3145d2838bd service nova] Enqueued Resource ID: f6cead7f-5ede-4097-9f73-f9849bdc96bc with Priority: HIGHEST for action port [ 782.211058] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_rules [ 782.211247] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 782.211353] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6cead7f-5ede-4097-9f73-f9849bdc96bc with Priority: HIGHEST for action port [ 782.211631] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.211752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.211850] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.212339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.212339] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.213142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.213268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.213324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.213499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.213644] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.213774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.213836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.213979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.214081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.214180] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.215175] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6cead7f-5ede-4097-9f73-f9849bdc96bc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.218938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6cead7f-5ede-4097-9f73-f9849bdc96bc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.218938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6cead7f-5ede-4097-9f73-f9849bdc96bc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.218938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6cead7f-5ede-4097-9f73-f9849bdc96bc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.218938] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6cead7f-5ede-4097-9f73-f9849bdc96bc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.720029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.720029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.720029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.720029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6cead7f-5ede-4097-9f73-f9849bdc96bc with status ACTIVE [ 782.720029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.720029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.720029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.720029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.720029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.720029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.729779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.729779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.729779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.729779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.729779] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.729779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.729779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.729779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.729779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.729779] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6cead7f-5ede-4097-9f73-f9849bdc96bc is going to be updated. [ 782.756047] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.756047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.756047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.756047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.756316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.756428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6cead7f-5ede-4097-9f73-f9849bdc96bc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.230902] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.561264] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac90853-4d65-407f-8da6-b4b200fba904 in Status: SUCCESS [ 783.561449] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac90853-4d65-407f-8da6-b4b200fba904 deletion is rescheduled due to dependency. [ 783.561569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.588187] env[61538]: INFO networking_nsxv3.common.synchronization [req-c6b63700-e8a9-450e-93f3-e19ecfdbfab5 req-e46e5654-1f80-46af-9625-86783bb7435e tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 783.588862] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 783.589253] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.589437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.589530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.589804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.590015] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.591051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.591051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.591198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.591232] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.591336] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.621780] env[61538]: INFO networking_nsxv3.common.synchronization [req-c6b63700-e8a9-450e-93f3-e19ecfdbfab5 req-e46e5654-1f80-46af-9625-86783bb7435e tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 783.624024] env[61538]: INFO networking_nsxv3.common.synchronization [req-c6b63700-e8a9-450e-93f3-e19ecfdbfab5 req-e46e5654-1f80-46af-9625-86783bb7435e tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 783.624024] env[61538]: INFO networking_nsxv3.common.synchronization [req-c6b63700-e8a9-450e-93f3-e19ecfdbfab5 req-e46e5654-1f80-46af-9625-86783bb7435e tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 2b9f3635-8a28-4d33-be62-134aabc38027 with Priority: HIGHEST for action port [ 783.624024] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 783.624838] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 783.624964] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b9f3635-8a28-4d33-be62-134aabc38027 with Priority: HIGHEST for action port [ 783.625286] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.625411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.625474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.625682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.625761] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.628939] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.630040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.630040] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b9f3635-8a28-4d33-be62-134aabc38027 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.630040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.630040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.630471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.630471] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9f3635-8a28-4d33-be62-134aabc38027',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.686227] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 783.686517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.732565] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.732883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.732883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.732951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.733061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.733169] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 is going to be created. [ 783.767715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.767933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.767933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.768226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.768343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.785301] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: UNINITIALIZED for 2s [ 784.097264] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.131983] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.132171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.133525] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b9f3635-8a28-4d33-be62-134aabc38027 with status ACTIVE [ 784.133713] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.133859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.133923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.134198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.134290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.134917] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.134917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.134917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.134917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.134917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.135158] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.135158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.135158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.135291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.135372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.135446] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b9f3635-8a28-4d33-be62-134aabc38027 is going to be updated. [ 784.160040] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.160177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.160303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.160524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.160659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.160817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.599468] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.105223] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.105223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.105223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.105223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.105223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.105223] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25706118-e879-4cb5-be84-a8ab078e932e is going to be updated. [ 785.140930] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.141116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.141155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.141375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.141519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.150882] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: IN_PROGRESS for 2s [ 785.489242] env[61538]: INFO networking_nsxv3.common.synchronization [req-72d3e66b-d0a6-40d3-a5a4-1d16f2579f55 req-3d4ec577-9a5a-49d9-9bd4-e9b7f696d670 tempest-ServerMetadataTestJSON-447458016 tempest-ServerMetadataTestJSON-447458016-project-member] Enqueued Resource ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e with Priority: HIGHEST for action security_group_members [ 785.489839] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e with Priority: HIGHEST for action security_group_members [ 785.490113] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-27cb37c1-ffde-4f82-835b-823e403e1b9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.490240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.490303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.490496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.490650] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.490749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.490803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.490942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.491053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.491142] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27cb37c1-ffde-4f82-835b-823e403e1b9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.796467] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: SUCCESS [ 785.796696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.796872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.797213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.797458] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.797611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.797689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.797835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.797914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.797994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.798095] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.994574] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.994716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.994751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.995010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.995204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.995456] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.996575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.996575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.996575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.996575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.996575] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e is going to be updated. [ 786.032208] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.032208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.032208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.032208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.032208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.052436] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e in Status: IN_PROGRESS for 2s [ 786.187949] env[61538]: INFO networking_nsxv3.common.synchronization [req-d2291fa0-367d-470f-99a8-06fb865cb2a7 req-23e13aee-67df-4fca-9ae3-9e5b9173a248 tempest-ServersAdminNegativeTestJSON-1477357562 tempest-ServersAdminNegativeTestJSON-1477357562-project-member] Enqueued Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 786.188684] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc with Priority: HIGHEST for action security_group_members [ 786.191078] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.191299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.191409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.195018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.195018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.195018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.195018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.195018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.195018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.195018] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f9cc04-e7d3-4a55-ba09-c74518d114dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.301819] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.302061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.302145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.302400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.302665] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.302782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.302782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.302908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.303061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.303181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.303342] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.303437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.303498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.303661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.303805] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.303899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.303959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.305181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.305181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.305181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.305181] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.698960] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.699218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.699345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.700541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.700541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.700790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.700875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.700954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.701173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.701286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.701396] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc is going to be updated. [ 786.737143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.737448] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.737527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.737745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.737886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.748239] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: IN_PROGRESS for 2s [ 786.806436] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3245ba1b-68f2-4ade-b795-a712f120d8b1: rpc.has_security_group_logging(os_id): False [ 786.830840] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.831289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.832246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.832540] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.832670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.832889] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.836020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.836020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.836020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.836020] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 is going to be created. [ 786.899774] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.900288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.900288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.900399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.900550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.914129] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: IN_PROGRESS for 2s [ 787.159632] env[61538]: INFO networking_nsxv3.common.synchronization [req-9478079f-0c30-4e5c-a5c1-c165092fb267 req-17bfa9fa-c90c-4ee3-ae55-a9cccc08a25c tempest-ListImageFiltersTestJSON-574044180 tempest-ListImageFiltersTestJSON-574044180-project-member] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 787.160669] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 787.161693] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.161943] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.162068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.162328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.162614] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.162746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.162853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.164883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.165014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.165244] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.169745] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: SUCCESS [ 787.169994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.170175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.170417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.170601] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.170714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.170799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.171067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.171170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.171322] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.519482] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.519842] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.519842] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.520270] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.520625] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.520852] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.521692] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.522025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.522205] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.522458] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.522681] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.522885] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.523087] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.523221] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.523331] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.523469] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.558560] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.558814] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 787.558878] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.559108] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.559446] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.559624] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.559751] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.560123] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.560272] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ecc6a7f-17b3-4e11-92bd-19f00ab1364e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.668363] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.677018] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.065285] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e in Status: SUCCESS [ 788.065285] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27cb37c1-ffde-4f82-835b-823e403e1b9e deletion is rescheduled due to dependency. [ 788.065285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27cb37c1-ffde-4f82-835b-823e403e1b9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.065285] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.065285] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.065285] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.065285] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.065285] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.065285] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 3ecc6a7f-17b3-4e11-92bd-19f00ab1364e not found, creating... [ 788.065285] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.065285] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.065285] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.065666] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.065666] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.066218] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.066683] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.066966] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.067336] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.067605] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.067871] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 3ecc6a7f-17b3-4e11-92bd-19f00ab1364e is going to be created. [ 788.093026] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.093026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.093026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.093026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.093026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.093026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.110626] env[61538]: INFO networking_nsxv3.common.synchronization [req-87df51c2-796c-46d4-be19-39fe180572b1 req-eda07c50-db65-4b34-8e8a-a46f9d42c4f1 tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 788.110626] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 788.110626] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.110626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.143031] env[61538]: INFO networking_nsxv3.common.synchronization [req-87df51c2-796c-46d4-be19-39fe180572b1 req-eda07c50-db65-4b34-8e8a-a46f9d42c4f1 tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 788.143031] env[61538]: INFO networking_nsxv3.common.synchronization [req-87df51c2-796c-46d4-be19-39fe180572b1 req-eda07c50-db65-4b34-8e8a-a46f9d42c4f1 tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 788.143031] env[61538]: INFO networking_nsxv3.common.synchronization [req-87df51c2-796c-46d4-be19-39fe180572b1 req-eda07c50-db65-4b34-8e8a-a46f9d42c4f1 tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 2b9f3635-8a28-4d33-be62-134aabc38027 with Priority: HIGHEST for action port [ 788.143031] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_rules [ 788.143031] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 788.143031] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b9f3635-8a28-4d33-be62-134aabc38027 with Priority: HIGHEST for action port [ 788.143467] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.143788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.146159] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.146159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.146159] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b9f3635-8a28-4d33-be62-134aabc38027 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.146159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.146159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.146159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.146159] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9f3635-8a28-4d33-be62-134aabc38027',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.171566] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.181348] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.648730] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b9f3635-8a28-4d33-be62-134aabc38027 with status ACTIVE [ 788.649110] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.649279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.649351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.649582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.649694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.649880] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.649976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.650051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.650204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.650283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.650462] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.650554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.650613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.650750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.650823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.650908] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b9f3635-8a28-4d33-be62-134aabc38027 is going to be updated. [ 788.674415] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.674415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.674559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.674701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.674840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.675009] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b9f3635-8a28-4d33-be62-134aabc38027" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.675374] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.675486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.675559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.675708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.675772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.675859] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 is going to be updated. [ 788.683950] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.684720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.684720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.684720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.684720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.684884] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25706118-e879-4cb5-be84-a8ab078e932e is going to be updated. [ 788.716560] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.717073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.717073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.717183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.717254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.719164] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.719416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.719543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.719762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.719958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.740944] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: IN_PROGRESS for 2s [ 788.744843] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: IN_PROGRESS for 2s [ 788.761565] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc in Status: SUCCESS [ 788.761770] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f9cc04-e7d3-4a55-ba09-c74518d114dc deletion is rescheduled due to dependency. [ 788.761848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f9cc04-e7d3-4a55-ba09-c74518d114dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.925771] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: SUCCESS [ 788.925840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.035862] env[61538]: INFO networking_nsxv3.common.synchronization [req-9478079f-0c30-4e5c-a5c1-c165092fb267 req-17114bf3-8553-4dbd-9b3c-7e0eecdef32a service nova] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_rules [ 789.036167] env[61538]: INFO networking_nsxv3.common.synchronization [req-9478079f-0c30-4e5c-a5c1-c165092fb267 req-17114bf3-8553-4dbd-9b3c-7e0eecdef32a service nova] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 789.036314] env[61538]: INFO networking_nsxv3.common.synchronization [req-9478079f-0c30-4e5c-a5c1-c165092fb267 req-17114bf3-8553-4dbd-9b3c-7e0eecdef32a service nova] Enqueued Resource ID: 3ecc6a7f-17b3-4e11-92bd-19f00ab1364e with Priority: HIGHEST for action port [ 789.036554] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_rules [ 789.036680] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 789.036770] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ecc6a7f-17b3-4e11-92bd-19f00ab1364e with Priority: HIGHEST for action port [ 789.037522] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.037744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.037844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.038154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.038290] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.039339] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.039484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.043243] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.043369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.043439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.043634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.043714] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ecc6a7f-17b3-4e11-92bd-19f00ab1364e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.546453] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.546704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.546830] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ecc6a7f-17b3-4e11-92bd-19f00ab1364e with status ACTIVE [ 789.546951] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.547119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.547155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.547358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.547451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.547623] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.547718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.547793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.547942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.548043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.548231] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.548321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.548383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.548520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.548596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.548679] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ecc6a7f-17b3-4e11-92bd-19f00ab1364e is going to be updated. [ 789.572372] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.572745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.572745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.572960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.573159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.573351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ecc6a7f-17b3-4e11-92bd-19f00ab1364e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.752997] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: SUCCESS [ 790.753384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.753485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.753708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.753958] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.754099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.754207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.754381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.754487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.754594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.754698] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.756444] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: SUCCESS [ 790.756616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.756767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.756944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.757188] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.757307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.757364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.757510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.757569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.757635] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.758441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.758603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.758805] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.758912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.758964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.759746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.760348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.760348] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.262637] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.264072] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.264984] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.766578] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.768788] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.769763] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25706118-e879-4cb5-be84-a8ab078e932e: rpc.has_security_group_logging(os_id): False [ 791.793868] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.794118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.794118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.794330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.794440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.794687] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.794779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.794840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.794995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.795174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.795174] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25706118-e879-4cb5-be84-a8ab078e932e is going to be updated. [ 791.873857] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.874160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.874160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.874326] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.874474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.888499] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: IN_PROGRESS for 2s [ 792.270960] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.271145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.271205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.271431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.271527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.271622] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25706118-e879-4cb5-be84-a8ab078e932e is going to be updated. [ 792.273644] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.273784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.273925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.274160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.274250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.274348] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 is going to be updated. [ 792.310042] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.310042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.310216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.310323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.310558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.313185] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.313349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.313696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.313696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.313975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.326642] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: IN_PROGRESS for 2s [ 792.327184] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: IN_PROGRESS for 2s [ 792.597268] env[61538]: INFO networking_nsxv3.common.synchronization [req-8d0f0bbc-3a76-4d99-ac84-1a474c5402bf req-beab888f-a3bd-4378-b88f-09313a77c333 tempest-AttachInterfacesUnderV243Test-426069374 tempest-AttachInterfacesUnderV243Test-426069374-project-member] Enqueued Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 792.597268] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25706118-e879-4cb5-be84-a8ab078e932e with Priority: HIGHEST for action security_group_members [ 792.597268] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-25706118-e879-4cb5-be84-a8ab078e932e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.600983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.902721] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: SUCCESS [ 793.902974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.904035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.904035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.904035] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.074569] env[61538]: INFO networking_nsxv3.common.synchronization [req-afdcdcfc-1598-4b49-bed9-450c0db8b7fa req-f05511c1-b91b-4a4e-b8d6-ef43b5de6219 tempest-ServerRescueNegativeTestJSON-252212181 tempest-ServerRescueNegativeTestJSON-252212181-project-member] Enqueued Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 794.075185] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 794.076265] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.076265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.076265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.076265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.076265] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.076265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.076709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.076709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.076709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.076709] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.349065] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25706118-e879-4cb5-be84-a8ab078e932e in Status: SUCCESS [ 794.349065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.349065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.349065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.349065] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.349065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.349065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.349065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.349065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.349065] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.350661] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: SUCCESS [ 794.351487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.352059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.356671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.356671] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.356671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.356671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.356671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.356671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.356671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.356671] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.427037] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.427037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.427037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.427037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.427037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.427037] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25706118-e879-4cb5-be84-a8ab078e932e is going to be deleted. [ 794.498187] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.498347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.498427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.498648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.498737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.498860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.513569] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.513776] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.513902] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.514384] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.514728] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.515103] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.515329] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.515631] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.515786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.516131] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.516208] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.516311] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.516429] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.516524] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.516630] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.516761] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.535524] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.535725] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.535845] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.536136] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.536441] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-ab535fb5-b111-46f9-8c40-e9647f50901b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.536620] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-ab535fb5-b111-46f9-8c40-e9647f50901b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.536741] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-ab535fb5-b111-46f9-8c40-e9647f50901b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.537122] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-ab535fb5-b111-46f9-8c40-e9647f50901b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.537318] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab535fb5-b111-46f9-8c40-e9647f50901b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.579664] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.579885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.580016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.580335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.580501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.580787] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.580901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.580969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.581189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.581276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.581367] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 already deleted. [ 794.581449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.859219] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.859386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.859456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.859677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.859847] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.859950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.860032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.860194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.860300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.860398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.860554] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.860663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.860722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.860858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.860993] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.861124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.861206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.861347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.861426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.861509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.861609] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.862808] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.862919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.862988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.863169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.863254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.863413] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.863504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.863562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.863690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.863762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.863851] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25706118-e879-4cb5-be84-a8ab078e932e is going to be deleted. [ 794.954883] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.954883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.955281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.955281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.955281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.955374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.955521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.955675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.955832] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.955932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.956096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.956266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.956874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.956874] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25706118-e879-4cb5-be84-a8ab078e932e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.039554] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.039836] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.039912] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.040210] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.040370] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.040608] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port ab535fb5-b111-46f9-8c40-e9647f50901b not found, creating... [ 795.040947] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.041150] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.041325] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.041630] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.041818] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.042227] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.042431] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.042602] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.042808] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.043010] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.043206] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: ab535fb5-b111-46f9-8c40-e9647f50901b is going to be created. [ 795.066425] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.066846] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.066962] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.067293] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.067553] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.067821] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-ab535fb5-b111-46f9-8c40-e9647f50901b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.365575] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3245ba1b-68f2-4ade-b795-a712f120d8b1: rpc.has_security_group_logging(os_id): False [ 795.383732] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.383998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.384131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.384372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.384479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.384737] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.384857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.384923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.385213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.385301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.385522] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.385617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.385820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.385820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.385965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.386142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.386236] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.386297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.386458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.386544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.386631] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 is going to be updated. [ 795.452972] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.453192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.453304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.453634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.453740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.458876] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.458998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.459111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.459387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.459387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.459609] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.459706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.459756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.459925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.459998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.460166] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25706118-e879-4cb5-be84-a8ab078e932e already deleted. [ 795.460255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25706118-e879-4cb5-be84-a8ab078e932e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.468187] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: IN_PROGRESS for 2s [ 795.968203] env[61538]: INFO networking_nsxv3.common.synchronization [req-afdcdcfc-1598-4b49-bed9-450c0db8b7fa req-793724fd-ead3-4ca1-8edf-7959d1e5d8c5 service nova] Enqueued Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_rules [ 795.968490] env[61538]: INFO networking_nsxv3.common.synchronization [req-afdcdcfc-1598-4b49-bed9-450c0db8b7fa req-793724fd-ead3-4ca1-8edf-7959d1e5d8c5 service nova] Enqueued Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 795.968578] env[61538]: INFO networking_nsxv3.common.synchronization [req-afdcdcfc-1598-4b49-bed9-450c0db8b7fa req-793724fd-ead3-4ca1-8edf-7959d1e5d8c5 service nova] Enqueued Resource ID: ab535fb5-b111-46f9-8c40-e9647f50901b with Priority: HIGHEST for action port [ 795.970797] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_rules [ 795.971018] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 795.971132] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab535fb5-b111-46f9-8c40-e9647f50901b with Priority: HIGHEST for action port [ 795.971568] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.971708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.971783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.973030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.973030] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.974388] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.974536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.974604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.974801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.974962] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.975082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.975136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.975295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.975381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.975511] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.976827] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab535fb5-b111-46f9-8c40-e9647f50901b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.976937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab535fb5-b111-46f9-8c40-e9647f50901b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.977027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab535fb5-b111-46f9-8c40-e9647f50901b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.977299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab535fb5-b111-46f9-8c40-e9647f50901b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.977400] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab535fb5-b111-46f9-8c40-e9647f50901b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.481659] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab535fb5-b111-46f9-8c40-e9647f50901b with status ACTIVE [ 796.481734] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.481872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.482028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.482377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.482377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.482508] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.482586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.482646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.482795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.482868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.483055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.483148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.483208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.483369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.483495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.483536] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab535fb5-b111-46f9-8c40-e9647f50901b is going to be updated. [ 796.485855] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.487728] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.487728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.516571] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.516782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.516855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.517145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.517297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.517464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab535fb5-b111-46f9-8c40-e9647f50901b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.869835] env[61538]: INFO networking_nsxv3.common.synchronization [req-15ed074c-f131-40fa-a3bf-e0f3b6bb19ec req-6a56922a-75a9-45a7-a125-ea56267654c7 tempest-ServerPasswordTestJSON-1891337064 tempest-ServerPasswordTestJSON-1891337064-project-member] Enqueued Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGHEST for action security_group_members [ 796.871679] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGHEST for action security_group_members [ 796.871679] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a503fb1-ef80-462f-8967-ba77e7b55111 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.871679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.871679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.871679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.871679] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.871679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.871679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.871679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.871679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.871679] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a503fb1-ef80-462f-8967-ba77e7b55111',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.990304] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.378715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.378715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.378715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.378715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.378715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.378715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.378715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.378715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.378715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.378715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.378715] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 already deleted. [ 797.378715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.484544] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: SUCCESS [ 797.484796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.494505] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.494640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.494749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.494930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.495035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.495133] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 is going to be created. [ 797.520629] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.520840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.520840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.521085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.521335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.530860] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.531081] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-519" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.531208] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-519" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.531537] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-519" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.531804] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.531962] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.532156] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.532403] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.532552] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.532761] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.532876] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.532987] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.533112] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.533221] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.533344] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.533480] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.535236] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: UNINITIALIZED for 2s [ 797.555868] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.556154] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.556362] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.556592] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-519" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.557091] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.560116] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.560116] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.560116] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.561989] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('613c36a6-a4a9-4e6d-9252-7f43cd7584ff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.066160] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.066160] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.066160] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.066160] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.066662] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.066662] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 613c36a6-a4a9-4e6d-9252-7f43cd7584ff not found, creating... [ 798.066662] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.066832] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.067221] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.067221] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.067326] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.067620] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.067779] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.067897] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.068117] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.068257] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.068396] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 613c36a6-a4a9-4e6d-9252-7f43cd7584ff is going to be created. [ 798.092816] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.093151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.093151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.093438] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.093669] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.093927] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.022334] env[61538]: INFO networking_nsxv3.common.synchronization [req-15ed074c-f131-40fa-a3bf-e0f3b6bb19ec req-a89f4f45-d6f8-409b-a9e5-241f14e74683 service nova] Enqueued Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGHEST for action security_group_rules [ 799.022504] env[61538]: INFO networking_nsxv3.common.synchronization [req-15ed074c-f131-40fa-a3bf-e0f3b6bb19ec req-a89f4f45-d6f8-409b-a9e5-241f14e74683 service nova] Enqueued Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGHEST for action security_group_members [ 799.022642] env[61538]: INFO networking_nsxv3.common.synchronization [req-15ed074c-f131-40fa-a3bf-e0f3b6bb19ec req-a89f4f45-d6f8-409b-a9e5-241f14e74683 service nova] Enqueued Resource ID: 613c36a6-a4a9-4e6d-9252-7f43cd7584ff with Priority: HIGHEST for action port [ 799.022874] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGHEST for action security_group_rules [ 799.023014] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGHEST for action security_group_members [ 799.023128] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 613c36a6-a4a9-4e6d-9252-7f43cd7584ff with Priority: HIGHEST for action port [ 799.025144] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a503fb1-ef80-462f-8967-ba77e7b55111 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.025284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.025354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.025613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.025697] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a503fb1-ef80-462f-8967-ba77e7b55111',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.026807] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a503fb1-ef80-462f-8967-ba77e7b55111 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.026807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.026807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.027115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.027192] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.027265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.027321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.027495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.027602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.027767] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a503fb1-ef80-462f-8967-ba77e7b55111',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.028531] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.028648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.028741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.028971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.029132] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('613c36a6-a4a9-4e6d-9252-7f43cd7584ff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.530579] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a503fb1-ef80-462f-8967-ba77e7b55111 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.530912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.530912] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a503fb1-ef80-462f-8967-ba77e7b55111',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.531827] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 613c36a6-a4a9-4e6d-9252-7f43cd7584ff with status ACTIVE [ 799.531998] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.532143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.532216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.532428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.532525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.532710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.532783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.532899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.532974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.533076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.533256] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.533349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.533408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.533542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.533616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.533697] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 613c36a6-a4a9-4e6d-9252-7f43cd7584ff is going to be updated. [ 799.549467] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: SUCCESS [ 799.549637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.549771] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.549987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.550216] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.550340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.550404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.550553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.550636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.550719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.550807] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.560020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.560199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.560246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.560429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.560565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.560748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-613c36a6-a4a9-4e6d-9252-7f43cd7584ff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.036459] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a503fb1-ef80-462f-8967-ba77e7b55111',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.052929] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.053166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.053166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.053324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.053504] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.053671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.053671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.053815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.053914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.054025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.054177] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.054267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.054321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.054476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.054617] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.054702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.054762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.054889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.054963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.055060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.055145] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.543229] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.543538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.543538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.543698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.543755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.543830] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 is going to be created. [ 800.561022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c83b44db-0e9f-4fe1-b8a5-20122469f727: rpc.has_security_group_logging(os_id): False [ 800.570607] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.570607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.570607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.570607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.570607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.579343] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.579488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.579539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.579739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.579826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.580039] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.580140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.580201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.580342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.580420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.580587] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.580676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.580734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.580866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.580938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.581127] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.581218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.581277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.581411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.581483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.581563] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 is going to be created. [ 800.583566] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 in Status: UNINITIALIZED for 2s [ 800.662042] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.662042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.662042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.662042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.662042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.672805] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: IN_PROGRESS for 2s [ 802.409126] env[61538]: INFO networking_nsxv3.common.synchronization [req-52efc35f-c173-4803-9921-887c11a64e36 req-c3be241a-0b42-416a-b7a8-50b577bb3f64 tempest-ServersTestFqdnHostnames-1717368552 tempest-ServersTestFqdnHostnames-1717368552-project-member] Enqueued Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_members [ 802.409126] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGHEST for action security_group_members [ 802.409126] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-850cf150-e9b7-4aa9-8141-ddd003b7e560 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.409126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.409126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.409655] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.409907] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.410167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.410628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.410886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.411084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.411323] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.595020] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 in Status: SUCCESS [ 802.595361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.595666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.595938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.596222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.596400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.596538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.596783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.596941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.597152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.597307] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a503fb1-ef80-462f-8967-ba77e7b55111',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.720164] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: SUCCESS [ 802.720345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.919104] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.919307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.919348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.919587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.920174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.920407] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.920518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.920580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.920755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.920838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.920928] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 is going to be updated. [ 802.954412] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.954553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.954627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.954847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.954989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.964302] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 in Status: IN_PROGRESS for 2s [ 803.100709] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a503fb1-ef80-462f-8967-ba77e7b55111 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.100709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.100709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.100965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.101935] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.101935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.101935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.101935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.101935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.101935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.101935] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a503fb1-ef80-462f-8967-ba77e7b55111 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.101935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.101935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.101935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.102330] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.102330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.102330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.102330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.102444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.102471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.102540] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a503fb1-ef80-462f-8967-ba77e7b55111',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.171266] env[61538]: INFO networking_nsxv3.common.synchronization [None req-9b6d44a8-8b94-474f-a8c3-8e69325dd47b tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_rules [ 803.171266] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_rules [ 803.171266] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4854c6da-988b-40cb-9c61-b312f09d4a28 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.171266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.171266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.171266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.171824] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.257670] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c63c95bc-8c67-45a2-ba28-d6c1afb29f29 tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_rules [ 803.259156] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_rules [ 803.259156] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4854c6da-988b-40cb-9c61-b312f09d4a28 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.259307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.604669] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a503fb1-ef80-462f-8967-ba77e7b55111: rpc.has_security_group_logging(os_id): False [ 803.623630] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.623791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.623881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.624101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.624197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.624411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.624510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.624572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.624722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.624798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.624979] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.625114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.625149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.625277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.625342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.625519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.625612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.625673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.625810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.625885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.625972] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 is going to be created. [ 803.697514] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.697698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.697785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.698084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.698339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.700338] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.700481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.701060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.701060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.701060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.701060] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 already deleted. [ 803.701060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.701584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.701809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.701989] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.714261] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 in Status: IN_PROGRESS for 2s [ 804.238269] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.238493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.238542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.238789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.238895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.238991] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 already deleted. [ 804.239088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.974751] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 in Status: SUCCESS [ 804.975034] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 deletion is rescheduled due to dependency. [ 804.975085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.727772] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 in Status: SUCCESS [ 805.727772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.260649] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 808.260930] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 811.344461] env[61538]: INFO networking_nsxv3.common.synchronization [req-04625911-ce02-41fe-9844-53ff0cd3e991 req-a1fe25c4-4b3f-458f-8034-76ca85ce4c0a tempest-ServerPasswordTestJSON-1891337064 tempest-ServerPasswordTestJSON-1891337064-project-member] Enqueued Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGHEST for action security_group_members [ 811.345007] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGHEST for action security_group_members [ 811.345350] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a503fb1-ef80-462f-8967-ba77e7b55111 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.345487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.345546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.345773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.345939] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.347612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.347824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.347901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.347996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.348122] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a503fb1-ef80-462f-8967-ba77e7b55111',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.850166] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.850398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.850398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.850522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.850619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.850811] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.850911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.850972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.851140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.851220] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.851293] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 is going to be updated. [ 811.878792] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.879020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.879020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.879203] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.879348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.887544] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 in Status: IN_PROGRESS for 2s [ 813.301646] env[61538]: INFO networking_nsxv3.common.synchronization [req-ca08b632-2825-4722-a695-cc1052cd5a37 req-47d049f6-b010-4f1e-a0ed-56d418443454 tempest-ServerRescueNegativeTestJSON-252212181 tempest-ServerRescueNegativeTestJSON-252212181-project-member] Enqueued Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 813.302504] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 813.302504] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.302658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.302698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.302888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.303190] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.303315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.303374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.303533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.303625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.303716] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.760658] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.760875] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.761013] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.761319] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.761588] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.762045] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.762045] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.762275] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.762438] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.762998] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.762998] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.762998] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.762998] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.763214] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.763276] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.763366] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.785398] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.785585] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 813.785831] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.786032] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.786491] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-bb1a376a-94fe-4856-ab21-de3f98dda10e taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.786735] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-bb1a376a-94fe-4856-ab21-de3f98dda10e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.786935] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-bb1a376a-94fe-4856-ab21-de3f98dda10e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.790421] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-bb1a376a-94fe-4856-ab21-de3f98dda10e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.790421] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb1a376a-94fe-4856-ab21-de3f98dda10e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.808932] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.898673] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 in Status: SUCCESS [ 813.898872] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 deletion is rescheduled due to dependency. [ 813.898972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.291083] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.291083] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.291083] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.291083] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.291407] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.291407] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port bb1a376a-94fe-4856-ab21-de3f98dda10e not found, creating... [ 814.291559] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.291719] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.291835] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.292125] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.292275] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.292580] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.292769] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.292893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.293178] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.293382] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.293581] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: bb1a376a-94fe-4856-ab21-de3f98dda10e is going to be created. [ 814.309961] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.319536] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.320080] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.320194] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.320555] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.320886] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.321212] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-bb1a376a-94fe-4856-ab21-de3f98dda10e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.812025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.812025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.812025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.812240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.812289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.812404] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 is going to be updated. [ 814.848367] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.848571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.848649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.848883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.849095] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.859645] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: IN_PROGRESS for 2s [ 815.174343] env[61538]: INFO networking_nsxv3.common.synchronization [req-ca08b632-2825-4722-a695-cc1052cd5a37 req-d8ae6181-21b3-4e60-aa0a-fe01af8678c7 service nova] Enqueued Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_rules [ 815.174418] env[61538]: INFO networking_nsxv3.common.synchronization [req-ca08b632-2825-4722-a695-cc1052cd5a37 req-d8ae6181-21b3-4e60-aa0a-fe01af8678c7 service nova] Enqueued Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 815.174513] env[61538]: INFO networking_nsxv3.common.synchronization [req-ca08b632-2825-4722-a695-cc1052cd5a37 req-d8ae6181-21b3-4e60-aa0a-fe01af8678c7 service nova] Enqueued Resource ID: bb1a376a-94fe-4856-ab21-de3f98dda10e with Priority: HIGHEST for action port [ 815.175143] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_rules [ 815.175290] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 815.175444] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1a376a-94fe-4856-ab21-de3f98dda10e with Priority: HIGHEST for action port [ 815.175674] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.175862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.175862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.176064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.176482] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.177323] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.177483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.177766] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb1a376a-94fe-4856-ab21-de3f98dda10e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.177934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb1a376a-94fe-4856-ab21-de3f98dda10e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.178015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb1a376a-94fe-4856-ab21-de3f98dda10e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.178205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb1a376a-94fe-4856-ab21-de3f98dda10e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.178282] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb1a376a-94fe-4856-ab21-de3f98dda10e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.681047] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.681047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.681459] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb1a376a-94fe-4856-ab21-de3f98dda10e with status ACTIVE [ 815.681459] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.681459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.681770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.681770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.681906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.681949] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.682100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.682199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.682385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.682487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.682679] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.683283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.683283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.683283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.683283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.683283] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb1a376a-94fe-4856-ab21-de3f98dda10e is going to be updated. [ 815.704378] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.704558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.704597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.705159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.705159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.705159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb1a376a-94fe-4856-ab21-de3f98dda10e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.288400] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-8387593a-ec5a-40e0-b722-e8dd9b6a50a7 tempest-ListServersNegativeTestJSON-2137231986 tempest-ListServersNegativeTestJSON-2137231986-project-member] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 816.288920] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 816.290057] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.290057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.290057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.294163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.294265] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.294437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.294504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.294629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.294716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.294812] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.800135] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.800414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.800414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.800559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.800591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.802066] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.802066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.802066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.802066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.802066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.802066] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab already deleted. [ 816.802066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.869824] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: SUCCESS [ 816.870054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.870228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.870465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.870655] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.870784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.870823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.870972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.871070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.871170] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.949229] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.949431] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.949593] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.950659] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.950659] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.950659] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.950659] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.951043] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.951043] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.951368] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.951482] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.951591] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.951694] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.951800] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.951901] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.952043] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.972201] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.972291] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.972386] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.972589] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.972900] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-5d92ef0a-2647-43af-b441-58b6137c730e taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.973081] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-5d92ef0a-2647-43af-b441-58b6137c730e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.973201] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-5d92ef0a-2647-43af-b441-58b6137c730e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.973521] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-5d92ef0a-2647-43af-b441-58b6137c730e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.973659] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d92ef0a-2647-43af-b441-58b6137c730e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.373473] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.476361] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.476611] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.476729] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.477629] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.477629] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.477629] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 5d92ef0a-2647-43af-b441-58b6137c730e not found, creating... [ 817.477629] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.477866] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.477866] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.478058] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.478206] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.478575] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.478865] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.478865] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.478951] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.479092] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.479236] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 5d92ef0a-2647-43af-b441-58b6137c730e is going to be created. [ 817.500947] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.501300] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.501300] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.501570] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.501851] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.502583] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-5d92ef0a-2647-43af-b441-58b6137c730e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.875294] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.339476] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-b68e5cf5-8534-4337-a4e6-453eb5960fdb service nova] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_rules [ 818.339649] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-b68e5cf5-8534-4337-a4e6-453eb5960fdb service nova] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 818.339788] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-b68e5cf5-8534-4337-a4e6-453eb5960fdb service nova] Enqueued Resource ID: 5d92ef0a-2647-43af-b441-58b6137c730e with Priority: HIGHEST for action port [ 818.340031] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_rules [ 818.340165] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 818.340264] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92ef0a-2647-43af-b441-58b6137c730e with Priority: HIGHEST for action port [ 818.340795] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.340914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.341027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.343176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.343283] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.344208] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.344344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.344418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.344606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.344790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.344914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.344981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.345169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.345265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.345380] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.346222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d92ef0a-2647-43af-b441-58b6137c730e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.346360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d92ef0a-2647-43af-b441-58b6137c730e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.346434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d92ef0a-2647-43af-b441-58b6137c730e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.346615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d92ef0a-2647-43af-b441-58b6137c730e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.346696] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d92ef0a-2647-43af-b441-58b6137c730e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.378538] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.378741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.378791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.378999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.379108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.379206] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 is going to be updated. [ 818.412143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.412348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.412348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.412507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.412652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.422476] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: IN_PROGRESS for 2s [ 818.848507] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.850135] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.850135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.850135] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d92ef0a-2647-43af-b441-58b6137c730e with status ACTIVE [ 818.850322] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.850322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.850422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.850548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.850637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.850796] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.850887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.850944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.851100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.851198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.851347] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.851440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.851500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.851636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.851709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.851790] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d92ef0a-2647-43af-b441-58b6137c730e is going to be updated. [ 818.874759] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.875009] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.875069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.875280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.875419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.875656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d92ef0a-2647-43af-b441-58b6137c730e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.098306] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-6d16e233-41f7-4a5e-984c-a8784aed015a tempest-ListServersNegativeTestJSON-2137231986 tempest-ListServersNegativeTestJSON-2137231986-project-member] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 819.098838] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 819.099142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.099242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.354149] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.856693] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.857205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.857376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.857691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.857839] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.858022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be created. [ 819.884774] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.885118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.885118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.885226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.885382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.896748] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: UNINITIALIZED for 2s [ 820.102573] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.102804] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.102932] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.103228] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.103572] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.103678] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.103765] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.103993] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.104182] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.104497] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.104628] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.104718] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.104832] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.104933] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.105048] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.105180] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.124989] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.125291] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 820.125501] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.125761] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.126243] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-70ed8a3b-0e27-462d-84c6-05185727c589 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.126500] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-70ed8a3b-0e27-462d-84c6-05185727c589" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.126639] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-70ed8a3b-0e27-462d-84c6-05185727c589" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.126960] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-70ed8a3b-0e27-462d-84c6-05185727c589" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.127168] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70ed8a3b-0e27-462d-84c6-05185727c589',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.433224] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: SUCCESS [ 820.433567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.433629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.434212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.434212] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.434407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.434407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.434533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.434654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.434721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.434817] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.630228] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.630438] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.630570] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.631440] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.631440] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.631440] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 70ed8a3b-0e27-462d-84c6-05185727c589 not found, creating... [ 820.631828] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.632104] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.632521] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.633042] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.633042] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.633654] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.633654] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.633654] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.633969] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.634224] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.634349] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 70ed8a3b-0e27-462d-84c6-05185727c589 is going to be created. [ 820.662797] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.663018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.663154] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.663438] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.663677] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.664388] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-70ed8a3b-0e27-462d-84c6-05185727c589" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.937468] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.937820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.937820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.938527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.938527] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.938527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.938527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.938761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.938761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.938761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.938884] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.938944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.939067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.939265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.939336] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.939404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.939457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.939562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.939650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.939735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.939820] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.442844] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c83b44db-0e9f-4fe1-b8a5-20122469f727: rpc.has_security_group_logging(os_id): False [ 821.466521] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.466715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.466715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.466942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.467052] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.467833] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.467833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.467833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.467833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.467833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.468143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.468143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.468143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.468143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.468328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.468384] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.468528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.468609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.468755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.468833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.468924] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 is going to be updated. [ 821.539031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.539275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.539275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.539473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.539654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.554815] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: IN_PROGRESS for 2s [ 821.683265] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-aa5f6104-67fd-4273-9a73-ff7e040e202a service nova] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_rules [ 821.683440] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-aa5f6104-67fd-4273-9a73-ff7e040e202a service nova] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 821.683577] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-aa5f6104-67fd-4273-9a73-ff7e040e202a service nova] Enqueued Resource ID: 70ed8a3b-0e27-462d-84c6-05185727c589 with Priority: HIGHEST for action port [ 821.683811] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_rules [ 821.683944] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 821.684071] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70ed8a3b-0e27-462d-84c6-05185727c589 with Priority: HIGHEST for action port [ 821.684666] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.684811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.685114] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.685713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.685945] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-70ed8a3b-0e27-462d-84c6-05185727c589 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.686066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70ed8a3b-0e27-462d-84c6-05185727c589" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.686164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70ed8a3b-0e27-462d-84c6-05185727c589" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.686456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70ed8a3b-0e27-462d-84c6-05185727c589" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.686554] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70ed8a3b-0e27-462d-84c6-05185727c589',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.907657] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 821.908693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.908693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.908693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.908693] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.908693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.908693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.910886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.910886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.910886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.910886] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.910886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.910886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.913549] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.913549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.913549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.913549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.913549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.913549] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.088646] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-771eb179-39b3-4aaa-a99d-f675eb33a0b0 tempest-ListServersNegativeTestJSON-2137231986 tempest-ListServersNegativeTestJSON-2137231986-project-member] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 822.088646] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 822.089224] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.089224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.191999] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70ed8a3b-0e27-462d-84c6-05185727c589 with status ACTIVE [ 822.192287] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.192421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.192501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.192771] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.192873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.193068] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.193177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.193267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.193459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.193560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.193823] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.193957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.194032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.194191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.194280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.194373] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70ed8a3b-0e27-462d-84c6-05185727c589 is going to be updated. [ 822.218640] env[61538]: INFO networking_nsxv3.common.synchronization [req-14d1c13d-c9c1-4e73-b335-92185ef305ac req-e55212c2-ce41-4c12-9f9c-d1b66df82da2 tempest-FloatingIPsAssociationTestJSON-741219197 tempest-FloatingIPsAssociationTestJSON-741219197-project-member] Enqueued Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 822.219321] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGHEST for action security_group_members [ 822.220754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.220754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.220754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.221302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.221302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.221459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70ed8a3b-0e27-462d-84c6-05185727c589" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.221690] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.221797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.221862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.222042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.222414] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.222516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.222585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.222796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.222916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.223029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.416219] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.416397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.416620] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.671619] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.671993] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.671993] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.672819] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.672819] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.672819] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.672938] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.673180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.673316] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.673566] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.673695] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.673826] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.674565] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.674565] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.674565] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.674565] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.700718] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.700718] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 822.700808] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.700967] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-842" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.701374] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-ca54cc50-d211-4ada-8e47-1747a860fa83 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.701716] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-ca54cc50-d211-4ada-8e47-1747a860fa83" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.701716] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-ca54cc50-d211-4ada-8e47-1747a860fa83" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.701964] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-ca54cc50-d211-4ada-8e47-1747a860fa83" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.702119] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca54cc50-d211-4ada-8e47-1747a860fa83',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.725822] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.725975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.726059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.726880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.726880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.726880] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.726880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.726880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.727101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.727101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.727194] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad is going to be updated. [ 822.761756] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.761920] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.762017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.762240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.762407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.774233] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: IN_PROGRESS for 2s [ 822.919294] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.204400] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.204727] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.204727] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.205085] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.205247] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.205404] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port ca54cc50-d211-4ada-8e47-1747a860fa83 not found, creating... [ 823.205662] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.205821] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.205939] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.206168] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.206371] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.206600] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.206757] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.206919] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.207136] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.207223] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.207363] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: ca54cc50-d211-4ada-8e47-1747a860fa83 is going to be created. [ 823.228987] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.229243] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.229372] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.229656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.229900] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.230135] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-ca54cc50-d211-4ada-8e47-1747a860fa83" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.425012] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.425012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.425012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.425012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.425012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.425012] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 823.456789] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.457618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.457618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.457618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.457618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.471390] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 823.597406] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: SUCCESS [ 823.597547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.150070] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-49c6d3a3-703b-4ed6-8a2e-9586a05b4e8e service nova] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_rules [ 824.150264] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-49c6d3a3-703b-4ed6-8a2e-9586a05b4e8e service nova] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 824.150388] env[61538]: INFO networking_nsxv3.common.synchronization [req-b622ba01-6bf1-4e83-8799-56669730b673 req-49c6d3a3-703b-4ed6-8a2e-9586a05b4e8e service nova] Enqueued Resource ID: ca54cc50-d211-4ada-8e47-1747a860fa83 with Priority: HIGHEST for action port [ 824.150620] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_rules [ 824.150751] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 824.150844] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca54cc50-d211-4ada-8e47-1747a860fa83 with Priority: HIGHEST for action port [ 824.151441] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.151544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.151730] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.151808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.151976] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca54cc50-d211-4ada-8e47-1747a860fa83 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.155209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca54cc50-d211-4ada-8e47-1747a860fa83" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.155287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca54cc50-d211-4ada-8e47-1747a860fa83" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.156601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca54cc50-d211-4ada-8e47-1747a860fa83" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.156601] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca54cc50-d211-4ada-8e47-1747a860fa83',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.659189] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca54cc50-d211-4ada-8e47-1747a860fa83 with status ACTIVE [ 824.659492] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.659605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.659675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.659898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.659989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.660183] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.660275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.660335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.660526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.660571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.660721] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.660814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.660864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.661013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.661096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.661182] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca54cc50-d211-4ada-8e47-1747a860fa83 is going to be updated. [ 824.689561] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.690084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.690168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.690416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.690613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.690807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca54cc50-d211-4ada-8e47-1747a860fa83" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.789456] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3a6fa36-755e-48b1-ab72-10594e3701ad in Status: SUCCESS [ 824.789694] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad deletion is rescheduled due to dependency. [ 824.789819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.998149] env[61538]: INFO networking_nsxv3.common.synchronization [req-eb857bce-6591-4553-8eba-39f69b9afc2c req-cbf1e8d0-e82d-4266-9ad7-5d80c9fc063f tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 824.998756] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 824.999117] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.999256] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.999324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.999589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.999758] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.999948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.999948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.003363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.003531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.003670] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.487645] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 825.487645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.487645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.487645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.487645] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.487645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.487645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.487645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.487645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.487645] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.506926] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.507094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.507166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.507450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.507551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.507759] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.507859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.507921] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.508080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.508157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.508336] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 already deleted. [ 825.508336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.995257] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.319938] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.319938] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.319938] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.320209] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.320262] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.321826] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.321826] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.321826] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.321826] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.321826] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.321826] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.321826] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.321826] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.321826] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.321826] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.321826] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.347246] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.347437] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 826.347546] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.347754] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.348088] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-a08667b0-f29d-4bd2-8394-b73a26086238 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.348290] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.348412] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.348764] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.348898] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a08667b0-f29d-4bd2-8394-b73a26086238',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.502262] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.685407] env[61538]: INFO networking_nsxv3.common.synchronization [None req-97195310-d5e4-4b4f-8313-4c84ff265964 None None] Enqueued Resource ID: 48572503-b50f-4022-ae1b-2c525a23408c with Priority: HIGHEST for action port [ 826.685658] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48572503-b50f-4022-ae1b-2c525a23408c with Priority: HIGHEST for action port [ 826.686261] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-48572503-b50f-4022-ae1b-2c525a23408c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.686413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48572503-b50f-4022-ae1b-2c525a23408c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.686488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48572503-b50f-4022-ae1b-2c525a23408c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.686710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48572503-b50f-4022-ae1b-2c525a23408c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.686791] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48572503-b50f-4022-ae1b-2c525a23408c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.852623] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.853013] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.853252] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.856858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.856858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.856858] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port a08667b0-f29d-4bd2-8394-b73a26086238 not found, creating... [ 826.856858] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.856858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.856858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.856858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.856858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.856858] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.860694] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.860981] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.863145] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.863145] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.863145] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: a08667b0-f29d-4bd2-8394-b73a26086238 is going to be created. [ 826.886072] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.886072] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.886072] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.886072] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.886072] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.886072] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.004383] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.004708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.004708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.004868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.004952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.005163] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 827.061374] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.061553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.061553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.061922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.062318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.074261] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 827.193079] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48572503-b50f-4022-ae1b-2c525a23408c [ 827.193437] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.195538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.195538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.195538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.195538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.195538] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48572503-b50f-4022-ae1b-2c525a23408c already deleted. [ 827.195538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48572503-b50f-4022-ae1b-2c525a23408c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.378219] env[61538]: INFO networking_nsxv3.common.synchronization [None req-fdf53c81-0636-4bf6-9456-134589de551e tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_rules [ 827.379508] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_rules [ 827.379826] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.379947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.380085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.380361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.380449] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.462248] env[61538]: INFO networking_nsxv3.common.synchronization [None req-eef7ba91-2654-4209-a4fa-ac220eea4a36 tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_rules [ 827.463038] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_rules [ 827.463786] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.463786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.904670] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.905104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.905263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.905546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.905651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.905769] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e already deleted. [ 827.905888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.906103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.906367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.906599] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.239975] env[61538]: INFO networking_nsxv3.common.synchronization [req-8787b054-00b4-44df-8989-6938469dfd5e req-9a85856b-ae7e-44b2-89be-0f5900ee9679 tempest-ServersV294TestFqdnHostnames-598528889 tempest-ServersV294TestFqdnHostnames-598528889-project-member] Enqueued Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_members [ 828.239975] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_members [ 828.239975] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded91e44-4a5f-4d2c-a527-86674f66c321 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.239975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.239975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.240670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.240670] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.240670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.240670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.240948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.240948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.240948] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.350422] env[61538]: INFO networking_nsxv3.common.synchronization [req-eb857bce-6591-4553-8eba-39f69b9afc2c req-289b39f1-47f9-46e8-90ec-3725ac0fc54b service nova] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_rules [ 828.350529] env[61538]: INFO networking_nsxv3.common.synchronization [req-eb857bce-6591-4553-8eba-39f69b9afc2c req-289b39f1-47f9-46e8-90ec-3725ac0fc54b service nova] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 828.350651] env[61538]: INFO networking_nsxv3.common.synchronization [req-eb857bce-6591-4553-8eba-39f69b9afc2c req-289b39f1-47f9-46e8-90ec-3725ac0fc54b service nova] Enqueued Resource ID: a08667b0-f29d-4bd2-8394-b73a26086238 with Priority: HIGHEST for action port [ 828.352310] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_rules [ 828.352310] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 828.352310] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a08667b0-f29d-4bd2-8394-b73a26086238 with Priority: HIGHEST for action port [ 828.352310] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.352310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.352310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.352768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.352768] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.354925] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.354925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.354925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.354925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.355180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.355241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.355275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.355434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.355538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.355720] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.358935] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a08667b0-f29d-4bd2-8394-b73a26086238 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.358935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.358935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.358935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.358935] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a08667b0-f29d-4bd2-8394-b73a26086238',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.434905] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.436529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.436529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.437435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.437435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.437435] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e already deleted. [ 828.437435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.746737] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.746737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.746737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.746737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.746737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.746737] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.746737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.746737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.746737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.746737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.746737] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ded91e44-4a5f-4d2c-a527-86674f66c321 already deleted. [ 828.746737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.858770] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.859038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.863357] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.864424] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a08667b0-f29d-4bd2-8394-b73a26086238 with status ACTIVE [ 828.864592] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.864711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.864799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.865093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.865224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.865368] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.865558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.865558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.865731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.865802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.865987] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.866103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.866170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.866345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.866433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.866633] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a08667b0-f29d-4bd2-8394-b73a26086238 is going to be updated. [ 828.893457] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.893578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.893649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.894605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.894760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.894937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.085894] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 829.086190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.086398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.086685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.086922] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.087076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.087162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.087363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.087494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.087594] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.137035] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.137260] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.137392] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.137733] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.138009] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.138403] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.138655] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.139099] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.139386] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.140378] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.140378] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.140378] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.140378] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.140378] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.140378] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.140378] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.162784] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.162784] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.162784] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.162784] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.162784] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-3f0de1dd-63b8-4054-827e-0daae86eaaa5 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.162784] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-3f0de1dd-63b8-4054-827e-0daae86eaaa5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.162784] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-3f0de1dd-63b8-4054-827e-0daae86eaaa5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.162784] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-3f0de1dd-63b8-4054-827e-0daae86eaaa5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.162784] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f0de1dd-63b8-4054-827e-0daae86eaaa5',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.191121] env[61538]: INFO networking_nsxv3.common.synchronization [None req-23e9fa09-fbf7-4bbf-91e3-df124928852f None None] Enqueued Resource ID: df3e5c72-9aad-4040-b0fb-cee62883dcc8 with Priority: HIGHEST for action port [ 829.191121] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df3e5c72-9aad-4040-b0fb-cee62883dcc8 with Priority: HIGHEST for action port [ 829.191121] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-df3e5c72-9aad-4040-b0fb-cee62883dcc8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.191121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df3e5c72-9aad-4040-b0fb-cee62883dcc8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.191121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df3e5c72-9aad-4040-b0fb-cee62883dcc8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.191121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df3e5c72-9aad-4040-b0fb-cee62883dcc8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.191657] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df3e5c72-9aad-4040-b0fb-cee62883dcc8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.368564] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.590111] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.666503] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.666783] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.666911] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.667269] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.667449] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.667605] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 3f0de1dd-63b8-4054-827e-0daae86eaaa5 not found, creating... [ 829.667892] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.668081] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.668206] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.668457] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.668602] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.668929] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.670088] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.671378] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.672037] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.672199] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.672354] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 3f0de1dd-63b8-4054-827e-0daae86eaaa5 is going to be created. [ 829.697551] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df3e5c72-9aad-4040-b0fb-cee62883dcc8 [ 829.697812] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.697986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.698052] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.698272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.698367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.698474] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df3e5c72-9aad-4040-b0fb-cee62883dcc8 already deleted. [ 829.700153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df3e5c72-9aad-4040-b0fb-cee62883dcc8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.700153] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.700153] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.700650] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.703688] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.703688] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.703688] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-3f0de1dd-63b8-4054-827e-0daae86eaaa5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.874379] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.874379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.874379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.874379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.874379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.874379] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 is going to be created. [ 829.918101] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.918101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.918101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.918746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.918746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.932768] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: UNINITIALIZED for 2s [ 830.095660] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.609111] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.609111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.609111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.609111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.609111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.609111] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 830.656500] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.657414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.659588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.659588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.659588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.676718] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 831.380521] env[61538]: INFO networking_nsxv3.common.synchronization [req-8787b054-00b4-44df-8989-6938469dfd5e req-60d5d3fd-1c7f-4651-ae04-dffce94e7a82 service nova] Enqueued Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_rules [ 831.380712] env[61538]: INFO networking_nsxv3.common.synchronization [req-8787b054-00b4-44df-8989-6938469dfd5e req-60d5d3fd-1c7f-4651-ae04-dffce94e7a82 service nova] Enqueued Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_members [ 831.380866] env[61538]: INFO networking_nsxv3.common.synchronization [req-8787b054-00b4-44df-8989-6938469dfd5e req-60d5d3fd-1c7f-4651-ae04-dffce94e7a82 service nova] Enqueued Resource ID: 3f0de1dd-63b8-4054-827e-0daae86eaaa5 with Priority: HIGHEST for action port [ 831.381421] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_rules [ 831.381555] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_members [ 831.381656] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f0de1dd-63b8-4054-827e-0daae86eaaa5 with Priority: HIGHEST for action port [ 831.381928] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ded91e44-4a5f-4d2c-a527-86674f66c321 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.382173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.382291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.382538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.382671] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.383651] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded91e44-4a5f-4d2c-a527-86674f66c321 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.383824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.383902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.384180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.384401] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.384577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.384635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.384819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.384955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.385101] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.389619] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f0de1dd-63b8-4054-827e-0daae86eaaa5 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.389619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f0de1dd-63b8-4054-827e-0daae86eaaa5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.389619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f0de1dd-63b8-4054-827e-0daae86eaaa5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.389619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f0de1dd-63b8-4054-827e-0daae86eaaa5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.389619] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f0de1dd-63b8-4054-827e-0daae86eaaa5',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.438455] env[61538]: INFO networking_nsxv3.common.synchronization [req-3fceed2b-d8c6-46fe-9364-3f08ef055bc7 req-678cd012-b675-4b34-b5a6-794d3c3144de tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 831.439456] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 831.440848] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.440848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.440848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.440848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.440848] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.440848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.440848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.441284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.441284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.441284] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.888828] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.889977] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded91e44-4a5f-4d2c-a527-86674f66c321 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.890146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.890300] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f0de1dd-63b8-4054-827e-0daae86eaaa5 with status ACTIVE [ 831.890459] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.890561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.890615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.890833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.890916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.891096] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.891188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.891252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.891411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.891491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.891672] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.891769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.891856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.892028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.892111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.892212] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f0de1dd-63b8-4054-827e-0daae86eaaa5 is going to be updated. [ 831.916309] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.916521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.916572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.916793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.916937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.917117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f0de1dd-63b8-4054-827e-0daae86eaaa5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.943428] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.943670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.943837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.944263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.944405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.944595] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.944717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.944829] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.945020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.945125] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.945241] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f already deleted. [ 831.945342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.957571] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: SUCCESS [ 831.957797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.958423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.958723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.959251] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.959251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.959251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.959445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.959445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.959559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.959608] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.272521] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-942 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.273764] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-942" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.274285] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-942" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.275261] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-942" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.275732] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.276059] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.276283] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.277240] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.277240] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.277380] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.278951] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.279619] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.283208] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.283208] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.283208] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.283208] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.303442] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.306546] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.306818] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.307033] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-942" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.307427] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-16667e69-57e6-426e-8b7e-0da6159f84bb taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.307641] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.307774] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.308309] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.308471] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16667e69-57e6-426e-8b7e-0da6159f84bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.394819] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.465086] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.465928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.466025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.466525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.466632] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.466763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.466826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.467018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.467172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.467172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.467426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.467886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.467886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.467886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.467886] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.468145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.468145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.468223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.468257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.468918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.468918] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.687912] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 832.688165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.688346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.688568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.688768] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.688886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.688952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.689142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.689206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.689324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.689496] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.689576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.689638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.689779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.689914] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.690035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.690195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.690341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.690418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.690500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.690588] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.692026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.692026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.692026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.692026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.692026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.692347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.692347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.692347] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.811520] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.811956] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.811956] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.812204] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.812375] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.812553] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 16667e69-57e6-426e-8b7e-0da6159f84bb not found, creating... [ 832.812846] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.813061] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.813137] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.813384] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.813532] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.813856] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.814027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.814158] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.814394] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.814551] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.814706] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 16667e69-57e6-426e-8b7e-0da6159f84bb is going to be created. [ 832.840541] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.840787] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.840917] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.841301] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.841568] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.841816] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.899822] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.900116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.900151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.901549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.901549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.901549] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ded91e44-4a5f-4d2c-a527-86674f66c321 is going to be created. [ 832.917590] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NSXv3 Agent Agent loop - iteration:0 completed [ 832.917710] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NSXv3 Agent Agent loop - iteration:1 started [ 832.948373] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.948373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.948373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.948373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.948373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.960343] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ded91e44-4a5f-4d2c-a527-86674f66c321 in Status: UNINITIALIZED for 2s [ 832.971583] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fbcfa9e-907b-4758-98b8-3e4aa52eed72: rpc.has_security_group_logging(os_id): False [ 833.002378] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.004356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.004356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.004356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.004356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.004356] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.004356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.004356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.004356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.004356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.004356] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.004356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.005900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.005900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.005900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.005900] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.006375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.006565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.006898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.008582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.008582] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 is going to be created. [ 833.097931] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.097931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.097931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.097931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.097931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.113560] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: IN_PROGRESS for 2s [ 833.197778] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc1293ec-0409-4faf-afb6-bd4a0b1e16ab: rpc.has_security_group_logging(os_id): False [ 833.199434] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.229952] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.229952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.229952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.230357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.230357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.230473] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.230549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.230601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.230722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.230800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.231097] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.231097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.231345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.231345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.231510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.231587] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.231684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.231684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.231842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.231925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.231997] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be created. [ 833.313850] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.314053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.314053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.314468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.314681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.330019] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 833.704882] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.904663] env[61538]: INFO networking_nsxv3.common.synchronization [req-3fceed2b-d8c6-46fe-9364-3f08ef055bc7 req-c4d5400b-a962-415e-8b30-377af85e0deb service nova] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 833.905009] env[61538]: INFO networking_nsxv3.common.synchronization [req-3fceed2b-d8c6-46fe-9364-3f08ef055bc7 req-c4d5400b-a962-415e-8b30-377af85e0deb service nova] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 833.905062] env[61538]: INFO networking_nsxv3.common.synchronization [req-3fceed2b-d8c6-46fe-9364-3f08ef055bc7 req-c4d5400b-a962-415e-8b30-377af85e0deb service nova] Enqueued Resource ID: 16667e69-57e6-426e-8b7e-0da6159f84bb with Priority: HIGHEST for action port [ 833.905359] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 833.905541] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 833.905700] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16667e69-57e6-426e-8b7e-0da6159f84bb with Priority: HIGHEST for action port [ 833.906456] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.906634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.906731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.907048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.907229] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.908262] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.908422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.909450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.909450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.909725] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.909861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.909965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.910295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.912823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.913109] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.914029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-16667e69-57e6-426e-8b7e-0da6159f84bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.914188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.914306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.914439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.914524] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16667e69-57e6-426e-8b7e-0da6159f84bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.207674] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.207777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.207860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.208136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.208226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.208268] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 834.240605] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.240690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.240774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.241010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.241179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.252963] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 834.417698] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.418833] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.418958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.419479] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16667e69-57e6-426e-8b7e-0da6159f84bb with status ACTIVE [ 834.419584] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.419686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.419749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.419959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.420058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.420294] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.420388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.420388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.423457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.423457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.423457] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.423457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.423457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.423457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.423457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.423457] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16667e69-57e6-426e-8b7e-0da6159f84bb is going to be updated. [ 834.452241] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.452241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.452753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.452753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.453195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.453195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.925414] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.973074] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ded91e44-4a5f-4d2c-a527-86674f66c321 in Status: SUCCESS [ 834.973309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.974654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.974654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.974654] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.974654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.974654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.974654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.975538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.975538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.975538] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.128406] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: SUCCESS [ 835.128658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.351045] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 835.351045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.351045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.351396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.351992] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.428965] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.428965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.428965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.428965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.428965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.428965] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be created. [ 835.463084] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.463084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.463084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.463084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.463084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.477897] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: UNINITIALIZED for 2s [ 835.478170] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.854553] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.854712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.983237] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ded91e44-4a5f-4d2c-a527-86674f66c321: rpc.has_security_group_logging(os_id): False [ 836.002126] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.002351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.002351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.002729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.002729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.002938] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.003044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.003104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.003263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.003341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.003428] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ded91e44-4a5f-4d2c-a527-86674f66c321 is going to be created. [ 836.120118] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.120321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.120321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.120539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.120726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.136032] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ded91e44-4a5f-4d2c-a527-86674f66c321 in Status: IN_PROGRESS for 2s [ 836.275128] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 836.275364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.275574] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.275803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.275997] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.276142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.276211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.276404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.280365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.280365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.280578] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.618034] env[61538]: INFO networking_nsxv3.common.synchronization [req-4e81e7a7-1dc2-4e51-942a-02f3f3665511 req-cfc2a17a-077b-48bf-8f12-812d0f80e4d2 tempest-ListServersNegativeTestJSON-2137231986 tempest-ListServersNegativeTestJSON-2137231986-project-member] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 836.618411] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 836.618738] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.618863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.618929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.619965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.619965] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.620149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.620149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.620324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.620448] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.620545] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.784153] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.784153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.122282] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.491417] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 837.491993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.492394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.492828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.493270] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.493607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.493851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.494310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.494593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.494824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.495057] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.624551] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.998098] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.998098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.998456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.998456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.998529] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.998631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.998693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.998833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.998920] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.999013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.999167] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.999240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.999378] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.999527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.999665] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.999754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.999821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.999955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.000040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.000319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.000319] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.129363] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.129363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.129363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.129363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.129363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.129363] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 838.152158] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ded91e44-4a5f-4d2c-a527-86674f66c321 in Status: SUCCESS [ 838.152382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.164140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.164376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.164535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.164776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.164932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.175354] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 838.506453] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6798f697-f08e-4d7d-8b6e-6fb13201518f: rpc.has_security_group_logging(os_id): False [ 838.527155] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.527322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.527386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.527748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.527748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.528634] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.528775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.528910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.529163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.529163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.529401] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.529858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.529858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.529858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.529858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.530187] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.531679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.531679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.531679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.531679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.531831] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be created. [ 838.606823] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.607280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.607280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.607434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.607674] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.620647] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 840.187304] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 840.187727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.187780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.187985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.188163] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.188285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.188349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.188501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.188584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.188688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.188847] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.188938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.188997] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.189152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.189288] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.189407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.189455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.189581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.190522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.190522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.190522] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.516042] env[61538]: INFO networking_nsxv3.common.synchronization [req-8115ca42-5f53-456e-9e4c-7b5a57246e89 req-b22871c4-9c77-4d9e-9776-798cae4d2619 tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 840.516042] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 840.516042] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.516319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.516319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.516461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.516629] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.516734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.516794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.516945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.520517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.520517] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.637147] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 840.637418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.693637] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc1293ec-0409-4faf-afb6-bd4a0b1e16ab: rpc.has_security_group_logging(os_id): False [ 840.719867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.719867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.719867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.724612] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.724612] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.724612] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.724612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.725087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.725087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.725087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.725087] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 840.807129] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.807417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.807494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.807754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.807913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.833545] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 841.022857] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.022857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.022857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.023186] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.023186] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.023981] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.023981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.023981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.023981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.024478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.024478] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 841.055601] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.055601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.055601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.055601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.055966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.077030] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 841.269937] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.270314] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.270314] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.270603] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.270933] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.271564] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.271726] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.272037] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.272210] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.272486] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.272621] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.272777] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.272978] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.273112] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.273282] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.273370] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.301298] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.303916] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.303916] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.303916] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.303916] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-1db9311b-fde5-4366-81bb-0717451a8c25 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.303916] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-1db9311b-fde5-4366-81bb-0717451a8c25" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.303916] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-1db9311b-fde5-4366-81bb-0717451a8c25" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.303916] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-1db9311b-fde5-4366-81bb-0717451a8c25" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.303916] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1db9311b-fde5-4366-81bb-0717451a8c25',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.806598] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.806825] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.806951] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.807343] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.807587] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.807816] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 1db9311b-fde5-4366-81bb-0717451a8c25 not found, creating... [ 841.808252] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.808510] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.808721] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.809379] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.809474] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.809944] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.810254] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.810470] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.810901] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.811076] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.811374] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 1db9311b-fde5-4366-81bb-0717451a8c25 is going to be created. [ 841.835610] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.835610] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.835823] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.836130] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.836247] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.836633] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-1db9311b-fde5-4366-81bb-0717451a8c25" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.710340] env[61538]: INFO networking_nsxv3.common.synchronization [req-8115ca42-5f53-456e-9e4c-7b5a57246e89 req-36f02508-57f5-4b8b-9410-879ecaf7c3de service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 842.710340] env[61538]: INFO networking_nsxv3.common.synchronization [req-8115ca42-5f53-456e-9e4c-7b5a57246e89 req-36f02508-57f5-4b8b-9410-879ecaf7c3de service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 842.710340] env[61538]: INFO networking_nsxv3.common.synchronization [req-8115ca42-5f53-456e-9e4c-7b5a57246e89 req-36f02508-57f5-4b8b-9410-879ecaf7c3de service nova] Enqueued Resource ID: 1db9311b-fde5-4366-81bb-0717451a8c25 with Priority: HIGHEST for action port [ 842.710340] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 842.710340] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 842.710340] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db9311b-fde5-4366-81bb-0717451a8c25 with Priority: HIGHEST for action port [ 842.710340] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.710340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.710340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.710340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.710340] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.713559] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.713867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.714251] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-1db9311b-fde5-4366-81bb-0717451a8c25 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.714821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1db9311b-fde5-4366-81bb-0717451a8c25" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.715051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1db9311b-fde5-4366-81bb-0717451a8c25" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.716867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1db9311b-fde5-4366-81bb-0717451a8c25" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.716867] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1db9311b-fde5-4366-81bb-0717451a8c25',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.848335] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 842.848565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.849295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.849525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.849631] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.090641] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 843.090641] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b deletion is rescheduled due to dependency. [ 843.090641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.090641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.090641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.090641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.090641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.090641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.090641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.090641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.090641] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.178883] env[61538]: INFO networking_nsxv3.common.synchronization [None req-3627a9e0-6bf7-4303-abfc-0c4212fe8dc7 None None] Enqueued Resource ID: b6a0c377-c211-4be3-864e-70119bc9eca8 with Priority: HIGHEST for action port [ 843.179762] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a0c377-c211-4be3-864e-70119bc9eca8 with Priority: HIGHEST for action port [ 843.180271] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6a0c377-c211-4be3-864e-70119bc9eca8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.180584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6a0c377-c211-4be3-864e-70119bc9eca8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.180761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6a0c377-c211-4be3-864e-70119bc9eca8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.181228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6a0c377-c211-4be3-864e-70119bc9eca8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.182527] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6a0c377-c211-4be3-864e-70119bc9eca8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.217398] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.217549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.217985] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1db9311b-fde5-4366-81bb-0717451a8c25 with status ACTIVE [ 843.218240] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.218336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.218336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.218716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.218716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.218828] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.218877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.219233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.219233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.219233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.219353] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.219403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.220015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.220015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.220015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.220015] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1db9311b-fde5-4366-81bb-0717451a8c25 is going to be updated. [ 843.243694] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.243897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.243970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.244192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.244387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.244578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1db9311b-fde5-4366-81bb-0717451a8c25" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.352056] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.352410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.352410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.352515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.352674] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.352861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.352861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.352979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.353081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.353168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.353264] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.429121] env[61538]: INFO networking_nsxv3.common.synchronization [req-91455120-6cf3-482c-b6d6-64230605969a req-75ba4f66-3530-4418-90c4-d23c3ed14800 tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 843.429702] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 843.430026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.430274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.430347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.430659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.430833] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.430939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.431009] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.431161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.431247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.431343] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.594809] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.685908] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6a0c377-c211-4be3-864e-70119bc9eca8 [ 843.685908] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.685908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.685908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.685908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.685908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.685908] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6a0c377-c211-4be3-864e-70119bc9eca8 already deleted. [ 843.685908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6a0c377-c211-4be3-864e-70119bc9eca8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.857737] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.858171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.858171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.858411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.861223] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.861478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.861597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.861948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.862149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.862322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.862550] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.862784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.862784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.862958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.863142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.863261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.863369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.863541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.863541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.863645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.863698] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.888129] env[61538]: INFO networking_nsxv3.common.synchronization [None req-d2a7089b-6b04-444f-a416-70d450acae78 tempest-AttachVolumeTestJSON-1443084926 tempest-AttachVolumeTestJSON-1443084926-project-member] Enqueued Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_rules [ 843.888129] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_rules [ 843.888129] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b226ae7-1968-4740-8cac-2825cb2bf00f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.888129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.888129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.888129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.888129] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.933914] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.934128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.934221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.935028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.935028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.935028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.935028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.935028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.935811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.935811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.935811] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc already deleted. [ 843.935811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.002509] env[61538]: INFO networking_nsxv3.common.synchronization [None req-6e6da177-5c66-492a-8800-b1c99635b55f tempest-AttachVolumeTestJSON-1443084926 tempest-AttachVolumeTestJSON-1443084926-project-member] Enqueued Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_rules [ 844.002509] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_rules [ 844.003350] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b226ae7-1968-4740-8cac-2825cb2bf00f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.003689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.101608] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.198816] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.199021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.199079] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.199795] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.199795] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.199905] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.199938] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.203885] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.203885] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.203885] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.203885] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.203885] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.203885] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.203885] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.203885] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.203885] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.224688] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.224976] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.226034] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.227181] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.227746] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-f5ad4055-0195-4342-9493-6b942aab9f3e taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.228083] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-f5ad4055-0195-4342-9493-6b942aab9f3e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.228353] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-f5ad4055-0195-4342-9493-6b942aab9f3e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.228841] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-f5ad4055-0195-4342-9493-6b942aab9f3e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.230078] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5ad4055-0195-4342-9493-6b942aab9f3e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.417255] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc1293ec-0409-4faf-afb6-bd4a0b1e16ab: rpc.has_security_group_logging(os_id): False [ 844.418857] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.418857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.419046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.419999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.419999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.419999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.419999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.419999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.419999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.419999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.419999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.420338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.420338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.420338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.420338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.420522] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.420700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.420700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.420810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.421689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.421689] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 844.447098] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.447568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.447568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.447770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.447807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.448358] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f already deleted. [ 844.448358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.448358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.448548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.448548] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.559680] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.559945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.560100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.560382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.560623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.576876] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 844.607767] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.608936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.608936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.608936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.608936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.608936] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 844.666408] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.666652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.666732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.666990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.667180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.678635] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 844.734556] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.734713] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.734815] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.735110] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.735270] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.735430] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port f5ad4055-0195-4342-9493-6b942aab9f3e not found, creating... [ 844.735701] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.735858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.736219] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.736219] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.736418] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.736738] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.736895] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.737024] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.738093] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.738274] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.738383] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: f5ad4055-0195-4342-9493-6b942aab9f3e is going to be created. [ 844.760940] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.761181] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.761314] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.761667] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.761843] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.762162] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-f5ad4055-0195-4342-9493-6b942aab9f3e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.979124] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.979124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.979124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.979124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.979615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.979615] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f already deleted. [ 844.979615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.751024] env[61538]: INFO networking_nsxv3.common.synchronization [None req-b83fb027-9e3f-4430-a5b1-e14d27d06a44 None None] Enqueued Resource ID: ced97699-79e2-46cb-8f2f-de902e296667 with Priority: HIGHEST for action port [ 845.751024] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ced97699-79e2-46cb-8f2f-de902e296667 with Priority: HIGHEST for action port [ 845.751024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ced97699-79e2-46cb-8f2f-de902e296667 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.751024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ced97699-79e2-46cb-8f2f-de902e296667" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.751024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ced97699-79e2-46cb-8f2f-de902e296667" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.753672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ced97699-79e2-46cb-8f2f-de902e296667" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.753672] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ced97699-79e2-46cb-8f2f-de902e296667',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.234896] env[61538]: INFO networking_nsxv3.common.synchronization [req-91455120-6cf3-482c-b6d6-64230605969a req-525b0488-ce3d-4109-9983-52dd333e84b4 service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 846.234896] env[61538]: INFO networking_nsxv3.common.synchronization [req-91455120-6cf3-482c-b6d6-64230605969a req-525b0488-ce3d-4109-9983-52dd333e84b4 service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 846.234896] env[61538]: INFO networking_nsxv3.common.synchronization [req-91455120-6cf3-482c-b6d6-64230605969a req-525b0488-ce3d-4109-9983-52dd333e84b4 service nova] Enqueued Resource ID: f5ad4055-0195-4342-9493-6b942aab9f3e with Priority: HIGHEST for action port [ 846.234896] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 846.234896] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 846.234896] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ad4055-0195-4342-9493-6b942aab9f3e with Priority: HIGHEST for action port [ 846.234896] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.234896] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.234896] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.234896] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.234896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.235907] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.235907] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5ad4055-0195-4342-9493-6b942aab9f3e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.235907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5ad4055-0195-4342-9493-6b942aab9f3e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.235907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5ad4055-0195-4342-9493-6b942aab9f3e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.235907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5ad4055-0195-4342-9493-6b942aab9f3e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.235907] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5ad4055-0195-4342-9493-6b942aab9f3e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.255500] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ced97699-79e2-46cb-8f2f-de902e296667 [ 846.255788] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.255925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.255987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.256289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.256404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.256511] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ced97699-79e2-46cb-8f2f-de902e296667 already deleted. [ 846.256594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ced97699-79e2-46cb-8f2f-de902e296667" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.593859] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 846.594095] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.690244] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 846.691016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.691322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.691322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.691496] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.691614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.691727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.693609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.693609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.693609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.697365] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.737105] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.737288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.740805] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.742518] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5ad4055-0195-4342-9493-6b942aab9f3e with status ACTIVE [ 846.742676] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.742940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.742940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.743608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.743608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.743608] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.743608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.743608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.744690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.744690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.745096] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.745096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.745096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.745449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.745672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.745819] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5ad4055-0195-4342-9493-6b942aab9f3e is going to be updated. [ 846.771136] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.771338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.771421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.771833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.771833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.772017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5ad4055-0195-4342-9493-6b942aab9f3e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.204719] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.204719] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.204719] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.204719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.205386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.205386] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.205386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.205386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.205386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.205386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.205386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.205386] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.248876] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.501562] env[61538]: INFO networking_nsxv3.common.synchronization [req-b8a92585-1d3a-4a1c-8b4f-c3ecfe6c6baa req-fda5a1f5-36e9-46ec-acd5-64776ebc066a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 847.501748] env[61538]: INFO networking_nsxv3.common.synchronization [req-b8a92585-1d3a-4a1c-8b4f-c3ecfe6c6baa req-fda5a1f5-36e9-46ec-acd5-64776ebc066a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 847.502272] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 847.502411] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 847.502685] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.502810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.502865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.506311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.506311] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.506311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.506311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.506311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.506311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.506311] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.506311] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.506742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.506742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.506967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.506967] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.510490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.510490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.510490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.510490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.510490] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.636717] env[61538]: INFO networking_nsxv3.common.synchronization [req-b8a92585-1d3a-4a1c-8b4f-c3ecfe6c6baa req-fda5a1f5-36e9-46ec-acd5-64776ebc066a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 847.636717] env[61538]: INFO networking_nsxv3.common.synchronization [req-b8a92585-1d3a-4a1c-8b4f-c3ecfe6c6baa req-fda5a1f5-36e9-46ec-acd5-64776ebc066a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 847.636717] env[61538]: INFO networking_nsxv3.common.synchronization [req-b8a92585-1d3a-4a1c-8b4f-c3ecfe6c6baa req-fda5a1f5-36e9-46ec-acd5-64776ebc066a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_rules [ 847.636717] env[61538]: INFO networking_nsxv3.common.synchronization [req-b8a92585-1d3a-4a1c-8b4f-c3ecfe6c6baa req-fda5a1f5-36e9-46ec-acd5-64776ebc066a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 847.636717] env[61538]: INFO networking_nsxv3.common.synchronization [req-b8a92585-1d3a-4a1c-8b4f-c3ecfe6c6baa req-fda5a1f5-36e9-46ec-acd5-64776ebc066a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 16667e69-57e6-426e-8b7e-0da6159f84bb with Priority: HIGHEST for action port [ 847.637215] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 847.637427] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_rules [ 847.637542] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16667e69-57e6-426e-8b7e-0da6159f84bb with Priority: HIGHEST for action port [ 847.638506] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 847.638506] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 847.638506] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.638506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.638506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.638842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.638842] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.639590] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.639662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.639744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.639940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.640028] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.640984] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-16667e69-57e6-426e-8b7e-0da6159f84bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.641207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.641274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.641446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.641505] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16667e69-57e6-426e-8b7e-0da6159f84bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.642201] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.642289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.642457] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.642534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.710254] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b: rpc.has_security_group_logging(os_id): False [ 847.735149] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.735410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.735528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.735835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.735954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.736252] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.736423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.736513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.736770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.736918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.737327] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.739145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.739145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.739145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.739145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.739145] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.739145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.739145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.739145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.739145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.739145] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 847.751182] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.751387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.751436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.751817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.751817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.751953] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be created. [ 847.778100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.778371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.778371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.778571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.778732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.790843] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: UNINITIALIZED for 2s [ 847.812997] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.817029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.817029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.817029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.817029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.823885] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 848.012127] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.012127] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.144225] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.144225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.144225] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.144225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.152026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16667e69-57e6-426e-8b7e-0da6159f84bb with status ACTIVE [ 848.152026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.152026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.152026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.152026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.152026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16667e69-57e6-426e-8b7e-0da6159f84bb is going to be updated. [ 848.180020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.180020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.180020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.180020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.180020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.180020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.513574] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.514611] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.725739] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 848.725883] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 65ce3e97-db41-488c-9988-1959f1dc1965 with Priority: HIGHEST for action security_group_members [ 848.726455] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 848.728033] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 848.728233] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ce3e97-db41-488c-9988-1959f1dc1965 with Priority: HIGHEST for action security_group_members [ 848.728379] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 848.728829] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.729406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.731019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ce3e97-db41-488c-9988-1959f1dc1965 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.731213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.731314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.731657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.731881] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.732034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.732129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.732337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.733632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.733632] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.733890] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.734048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.960326] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 65ce3e97-db41-488c-9988-1959f1dc1965 with Priority: HIGHEST for action security_group_rules [ 848.960548] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 65ce3e97-db41-488c-9988-1959f1dc1965 with Priority: HIGHEST for action security_group_members [ 848.960693] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 848.960913] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 848.960994] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_rules [ 848.961345] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 848.961592] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b8ffff6-736b-4857-ab36-df69c66d049d req-aa919fe1-4da1-448d-b2b3-77e73f346272 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 16667e69-57e6-426e-8b7e-0da6159f84bb with Priority: HIGHEST for action port [ 848.962435] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ce3e97-db41-488c-9988-1959f1dc1965 with Priority: HIGHEST for action security_group_rules [ 848.962672] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 848.963024] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 848.963024] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16667e69-57e6-426e-8b7e-0da6159f84bb with Priority: HIGHEST for action port [ 848.963132] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_rules [ 848.963187] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ce3e97-db41-488c-9988-1959f1dc1965 with Priority: HIGHEST for action security_group_members [ 848.963422] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 848.963633] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65ce3e97-db41-488c-9988-1959f1dc1965 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.963787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.963878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.964270] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.964270] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.965218] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.965316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.965576] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.965689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.966032] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-16667e69-57e6-426e-8b7e-0da6159f84bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.966120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.966178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.966352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.966625] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16667e69-57e6-426e-8b7e-0da6159f84bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.967293] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.967446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.967701] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ce3e97-db41-488c-9988-1959f1dc1965 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.967956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.968101] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.968226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.019212] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.019383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.019383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.019607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.019699] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.019797] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 is going to be created. [ 849.021262] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.021262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.021413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.021492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.021603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.021659] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 849.050448] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.050693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.050693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.051124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.051124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.054853] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.055047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.055047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.055254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.055386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.063115] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 849.063995] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: UNINITIALIZED for 2s [ 849.236747] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.471237] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16667e69-57e6-426e-8b7e-0da6159f84bb with status ACTIVE [ 849.471606] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.471818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.471918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.472244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.472469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.472654] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.472871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.473307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.473487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.473581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.474080] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.474162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.474194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.475055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.475055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.475055] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16667e69-57e6-426e-8b7e-0da6159f84bb is going to be updated. [ 849.476650] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ce3e97-db41-488c-9988-1959f1dc1965 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.476880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.502300] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.502899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.502899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.503126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.504363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.504480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16667e69-57e6-426e-8b7e-0da6159f84bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.741662] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.743170] env[61538]: INFO networking_nsxv3.common.synchronization [None req-422aa567-777e-4c07-b4dc-8a13c9554e17 None None] Enqueued Resource ID: e7b4a063-7c0c-4ed4-8531-5771301f42a8 with Priority: HIGHEST for action port [ 849.747022] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b4a063-7c0c-4ed4-8531-5771301f42a8 with Priority: HIGHEST for action port [ 849.747022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7b4a063-7c0c-4ed4-8531-5771301f42a8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.747022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7b4a063-7c0c-4ed4-8531-5771301f42a8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.747022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7b4a063-7c0c-4ed4-8531-5771301f42a8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.747522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7b4a063-7c0c-4ed4-8531-5771301f42a8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.747522] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7b4a063-7c0c-4ed4-8531-5771301f42a8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.801898] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 849.802161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.802357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.802585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.802780] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.802898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.802964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.803121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.803204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.803289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.803383] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.841461] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 849.841461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.245621] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.245621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.245621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.245621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.245621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.245621] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65ce3e97-db41-488c-9988-1959f1dc1965 is going to be created. [ 850.249909] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7b4a063-7c0c-4ed4-8531-5771301f42a8 [ 850.250180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.250365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.250440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.250665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.250816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.250919] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7b4a063-7c0c-4ed4-8531-5771301f42a8 already deleted. [ 850.251031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7b4a063-7c0c-4ed4-8531-5771301f42a8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.279025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.279025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.279025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.279025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.279025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.292166] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ce3e97-db41-488c-9988-1959f1dc1965 in Status: UNINITIALIZED for 2s [ 850.305841] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.306101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.306101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.307285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.307285] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.307285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.307285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.307285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.307285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.307285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.307285] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.307285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.308342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.308342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.308342] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.308342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.308342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.308342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.308342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.308342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.308342] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.810704] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fcbd20b-13e3-44c4-bf9a-746a1da000dc: rpc.has_security_group_logging(os_id): False [ 850.832648] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.832648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.832648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.832648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.832648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.832648] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.832648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.832648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.832974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.832974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.833037] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.837258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.837258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.837258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.837258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.837258] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.837258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.837258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.837258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.837258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.837258] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be created. [ 850.910255] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.910437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.910505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.910741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.910993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.931159] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 851.078680] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: SUCCESS [ 851.078897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.079169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.080763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.080763] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.080763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.080763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.082710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.082710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.084172] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.086353] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 851.087037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.087037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.089495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.091475] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.091475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.091475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.091475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.091475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.091475] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.593513] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.595369] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.095793] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.100046] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.308074] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ce3e97-db41-488c-9988-1959f1dc1965 in Status: SUCCESS [ 852.308858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.309061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.309361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.312031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.312031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.312031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.312031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.312031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.312031] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.599562] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.600509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.601965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.601965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.601965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.601965] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 is going to be updated. [ 852.603285] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.603285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.603471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.604275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.604275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.604275] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 852.642618] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.642796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.642837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.643038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.643185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.644930] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.645190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.645275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.645456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.645575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.656393] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 852.657354] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: IN_PROGRESS for 2s [ 852.809055] env[61538]: INFO networking_nsxv3.common.synchronization [None req-037eaed2-9a84-453a-bd68-6f7dc438c3a0 None None] Enqueued Resource ID: deca6314-8135-4c63-9dbe-8cb4e2c815e2 with Priority: HIGHEST for action port [ 852.809350] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deca6314-8135-4c63-9dbe-8cb4e2c815e2 with Priority: HIGHEST for action port [ 852.809927] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-deca6314-8135-4c63-9dbe-8cb4e2c815e2 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.810087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deca6314-8135-4c63-9dbe-8cb4e2c815e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.810169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deca6314-8135-4c63-9dbe-8cb4e2c815e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.810372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deca6314-8135-4c63-9dbe-8cb4e2c815e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.810454] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deca6314-8135-4c63-9dbe-8cb4e2c815e2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.814825] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.950107] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 852.950107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.952410] env[61538]: INFO networking_nsxv3.common.synchronization [req-d17f4927-8b4d-406c-be3c-7bd3595c9fb9 req-d71da8a2-19a1-406d-b45d-b7c19f80ebf2 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 with Priority: HIGHEST for action security_group_members [ 852.953013] env[61538]: INFO networking_nsxv3.common.synchronization [req-d17f4927-8b4d-406c-be3c-7bd3595c9fb9 req-d71da8a2-19a1-406d-b45d-b7c19f80ebf2 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 852.953623] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 with Priority: HIGHEST for action security_group_members [ 852.954252] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 852.955995] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0b01f8-8bd3-45e7-8856-ceefb328f253 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.955995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.955995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.955995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.955995] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.955995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.955995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.956328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.956328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.956444] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0b01f8-8bd3-45e7-8856-ceefb328f253',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.958348] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.958452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.958500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.958698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.958884] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.959055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.959118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.959267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.959353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.959440] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [req-d17f4927-8b4d-406c-be3c-7bd3595c9fb9 req-d71da8a2-19a1-406d-b45d-b7c19f80ebf2 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_rules [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [req-d17f4927-8b4d-406c-be3c-7bd3595c9fb9 req-d71da8a2-19a1-406d-b45d-b7c19f80ebf2 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [req-d17f4927-8b4d-406c-be3c-7bd3595c9fb9 req-d71da8a2-19a1-406d-b45d-b7c19f80ebf2 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 with Priority: HIGHEST for action security_group_rules [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [req-d17f4927-8b4d-406c-be3c-7bd3595c9fb9 req-d71da8a2-19a1-406d-b45d-b7c19f80ebf2 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 with Priority: HIGHEST for action security_group_members [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [req-d17f4927-8b4d-406c-be3c-7bd3595c9fb9 req-d71da8a2-19a1-406d-b45d-b7c19f80ebf2 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: a08667b0-f29d-4bd2-8394-b73a26086238 with Priority: HIGHEST for action port [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_rules [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 with Priority: HIGHEST for action security_group_rules [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a08667b0-f29d-4bd2-8394-b73a26086238 with Priority: HIGHEST for action port [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 853.009561] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 with Priority: HIGHEST for action security_group_members [ 853.009561] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.009561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.009561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.009561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.009561] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.011201] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc0b01f8-8bd3-45e7-8856-ceefb328f253 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.011201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.011201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.011201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.011429] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc0b01f8-8bd3-45e7-8856-ceefb328f253',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.015715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a08667b0-f29d-4bd2-8394-b73a26086238 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.015715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.015715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.015715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.015715] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a08667b0-f29d-4bd2-8394-b73a26086238',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.015715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.015715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.015715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0b01f8-8bd3-45e7-8856-ceefb328f253 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.015715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.314228] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deca6314-8135-4c63-9dbe-8cb4e2c815e2 [ 853.314555] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.314623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.314736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.314906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.315011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.315114] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deca6314-8135-4c63-9dbe-8cb4e2c815e2 already deleted. [ 853.315189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deca6314-8135-4c63-9dbe-8cb4e2c815e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.318747] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.460815] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc0b01f8-8bd3-45e7-8856-ceefb328f253',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.461912] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.515447] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0b01f8-8bd3-45e7-8856-ceefb328f253 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.515447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.515447] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.515447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.517150] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a08667b0-f29d-4bd2-8394-b73a26086238 with status ACTIVE [ 853.517518] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.517654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.517714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.517974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.518045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.518507] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.518507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.518507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.518728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.518728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.518850] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.518947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.518947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.519177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.519177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.519298] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a08667b0-f29d-4bd2-8394-b73a26086238 is going to be updated. [ 853.558876] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.560736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.560736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.560736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.560736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.560736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.824482] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.824482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.824482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.824482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.824482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.824482] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65ce3e97-db41-488c-9988-1959f1dc1965 is going to be updated. [ 853.858418] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.858418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.858418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.858418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.858418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.866263] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.866263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.866263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.866263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.866263] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.867834] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ce3e97-db41-488c-9988-1959f1dc1965 in Status: IN_PROGRESS for 2s [ 853.945045] env[61538]: INFO networking_nsxv3.common.synchronization [req-0cfe9e5d-7ded-408c-969d-31dc45a6176f req-ba1ed652-9123-40b7-b26c-077775853606 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 with Priority: HIGHEST for action security_group_members [ 853.945045] env[61538]: INFO networking_nsxv3.common.synchronization [req-0cfe9e5d-7ded-408c-969d-31dc45a6176f req-ba1ed652-9123-40b7-b26c-077775853606 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 853.945045] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 with Priority: HIGHEST for action security_group_members [ 853.945045] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 853.945045] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0b01f8-8bd3-45e7-8856-ceefb328f253 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.945777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.945777] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.945777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.963587] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc0b01f8-8bd3-45e7-8856-ceefb328f253',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.967258] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.009611] env[61538]: INFO networking_nsxv3.common.synchronization [req-0cfe9e5d-7ded-408c-969d-31dc45a6176f req-ba1ed652-9123-40b7-b26c-077775853606 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_rules [ 854.009872] env[61538]: INFO networking_nsxv3.common.synchronization [req-0cfe9e5d-7ded-408c-969d-31dc45a6176f req-ba1ed652-9123-40b7-b26c-077775853606 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 854.010430] env[61538]: INFO networking_nsxv3.common.synchronization [req-0cfe9e5d-7ded-408c-969d-31dc45a6176f req-ba1ed652-9123-40b7-b26c-077775853606 tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: a08667b0-f29d-4bd2-8394-b73a26086238 with Priority: HIGHEST for action port [ 854.011485] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_rules [ 854.011696] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 854.011831] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a08667b0-f29d-4bd2-8394-b73a26086238 with Priority: HIGHEST for action port [ 854.012247] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.012395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.012658] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.012770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.013016] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a08667b0-f29d-4bd2-8394-b73a26086238 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.013150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.013238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.013529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.013608] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a08667b0-f29d-4bd2-8394-b73a26086238',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.369733] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.465929] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.466129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.466177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.466490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.466600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.466710] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 is going to be created. [ 854.469733] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.469960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.470157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.470385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.470485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.470585] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 is going to be updated. [ 854.517013] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a08667b0-f29d-4bd2-8394-b73a26086238 with status ACTIVE [ 854.517268] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.517408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.517473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.517690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.517789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.517968] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.518077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.518461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.518461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.518461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.518624] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.518673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.518704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.518973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.519067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.519149] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a08667b0-f29d-4bd2-8394-b73a26086238 is going to be updated. [ 854.537581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.537800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.537845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.538112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.538290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.544445] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.544445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.544445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.544445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.544445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.557117] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: IN_PROGRESS for 2s [ 854.561899] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 in Status: UNINITIALIZED for 2s [ 854.580725] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.580725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.581042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.581042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.581327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.581425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.673416] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 854.673749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.674014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.674366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.674605] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.674786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.674896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.675215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.675348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.675480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.675599] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.677663] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: SUCCESS [ 854.677886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.678890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.678890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.678890] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.678890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.679507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.679507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.679507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.679507] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.681123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.681336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.681707] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.684108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.684108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.684108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.684108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.684108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.684108] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.684108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.684108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.684601] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.684601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.684601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.684601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.684731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.684767] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.871968] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.184563] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.184785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.186381] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.186381] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.187213] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.375440] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 855.375924] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 855.689441] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e844ad3e-80cf-412c-a6ea-015ade97cb73: rpc.has_security_group_logging(os_id): False [ 855.690588] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.692049] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.716140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.716299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.716363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.716671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.716784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.717080] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.717211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.717276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.717436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.719044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.719044] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 is going to be created. [ 855.774279] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.774479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.774584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.775043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.775250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.787195] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: IN_PROGRESS for 2s [ 855.879975] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ce3e97-db41-488c-9988-1959f1dc1965 in Status: SUCCESS [ 855.880223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.880580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.880859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.881129] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.881214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.881294] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.881464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.881553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.881636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.881731] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.192907] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.193422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.193422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.193677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.193766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.193935] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 856.195486] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.195600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.195640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.195793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.196504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.196504] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 is going to be updated. [ 856.235099] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.235255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.235347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.235534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.235694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.239219] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.239405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.239483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.239688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.240088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.255876] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 856.256689] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: IN_PROGRESS for 2s [ 856.319410] env[61538]: INFO networking_nsxv3.common.synchronization [None req-87a48326-4f90-4b84-a01c-b72f636c101b tempest-ServerRescueNegativeTestJSON-252212181 tempest-ServerRescueNegativeTestJSON-252212181-project-member] Enqueued Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_rules [ 856.320014] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_rules [ 856.320362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f48c1e26-03f2-45d2-b576-a2404afc7d50 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.320492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.320559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.321051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.321186] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.367847] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.368253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.368253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.368393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.382163] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 856.383078] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.384061] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 856.385981] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.398530] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1878906d-2f2f-4432-8d15-068377272b0d tempest-ServerRescueNegativeTestJSON-252212181 tempest-ServerRescueNegativeTestJSON-252212181-project-member] Enqueued Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_rules [ 856.399540] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_rules [ 856.399603] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f48c1e26-03f2-45d2-b576-a2404afc7d50 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.399705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.414687] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.418023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.418023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.418023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.419488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.419984] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 856.420469] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'a08667b0-f29d-4bd2-8394-b73a26086238'} {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 856.420469] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 856.472162] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.472677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.475027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.475027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.480913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.480913] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 856.571530] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: SUCCESS [ 856.571530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.571530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.571530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.571530] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.571530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.571530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.571530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.571530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.571530] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.573645] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 in Status: SUCCESS [ 856.574127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.578318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.578318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.578318] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.578318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.578318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.578318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.578318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.578318] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0b01f8-8bd3-45e7-8856-ceefb328f253',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.582110] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.583074] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.585026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.585026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.585026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.585026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 856.715572] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.718138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.718138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.718138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.718138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.718138] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:32. [ 856.718138] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'794d6c9f-f896-426d-a29e-0a532c759616', '3245ba1b-68f2-4ade-b795-a712f120d8b1', 'cc1293ec-0409-4faf-afb6-bd4a0b1e16ab', '7fcbd20b-13e3-44c4-bf9a-746a1da000dc', '5a503fb1-ef80-462f-8967-ba77e7b55111', '87950fcb-64a8-4442-9ae9-01d668ddee9e', '7e4fbaf8-8019-44da-bb3b-478c3b16eb47', 'ea2928f0-ca1a-4287-ba3e-ef5db6d0b393', 'b3a6fa36-755e-48b1-ab72-10594e3701ad', 'e844ad3e-80cf-412c-a6ea-015ade97cb73', '550dcd2b-7021-4904-a80d-13c93ea25fe6', '850cf150-e9b7-4aa9-8141-ddd003b7e560', '55b1455b-d54a-44cb-a3ce-90cc7f9dc00b', '11683c57-c820-44f9-8374-c60833d4038c', '8feb07e8-1e39-437e-8497-dad4b8420d11', '2824e3bd-37f2-4e0d-afe6-4e256a5a8cff', 'dac90853-4d65-407f-8da6-b4b200fba904', '7fc67a55-ecea-4935-9926-a0733e53d126', '6798f697-f08e-4d7d-8b6e-6fb13201518f', '9fbcfa9e-907b-4758-98b8-3e4aa52eed72', '27cb37c1-ffde-4f82-835b-823e403e1b9e', '0af22a35-c045-464f-ae65-fa54f84e116a', 'acdbba8b-e86f-40a9-8892-22733abd6f87', '7c2a68f3-1e90-484c-934f-cd67fcc8be6b', '365fd2af-187a-43da-9017-8bc6e06e1910', 'ded91e44-4a5f-4d2c-a527-86674f66c321', '500d868a-59d3-4e7e-a5ec-63123eb42a2d', '1447a613-37bb-4237-a379-2b84dc1ad40d', 'c83b44db-0e9f-4fe1-b8a5-20122469f727', '463a8c39-ee54-4fb8-a9f5-3967b4233a2e', 'c9f9cc04-e7d3-4a55-ba09-c74518d114dc', '580370e7-ea25-4027-912b-de772679071c'} {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 856.718138] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 856.744040] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.744040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.744040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.744040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.744040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.744040] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 856.744040] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 856.744040] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 856.812185] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.813932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.813932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.813932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.813932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.813932] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 856.813932] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 856.814249] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 856.814249] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 856.814249] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a08667b0-f29d-4bd2-8394-b73a26086238 with Priority: HIGH for action port [ 856.814249] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/32 resources of Type:Security Group Rules [ 856.814249] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGH for action security_group_rules [ 856.814429] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGH for action security_group_rules [ 856.814429] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGH for action security_group_rules [ 856.814511] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGH for action security_group_rules [ 856.814540] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGH for action security_group_rules [ 856.814704] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGH for action security_group_rules [ 856.814704] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGH for action security_group_rules [ 856.814704] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGH for action security_group_rules [ 856.814801] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGH for action security_group_rules [ 856.814853] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGH for action security_group_rules [ 856.814890] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGH for action security_group_rules [ 856.814929] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGH for action security_group_rules [ 856.814991] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGH for action security_group_rules [ 856.815185] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGH for action security_group_rules [ 856.815185] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGH for action security_group_rules [ 856.815185] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGH for action security_group_rules [ 856.815341] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGH for action security_group_rules [ 856.815341] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGH for action security_group_rules [ 856.815341] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGH for action security_group_rules [ 856.815442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.841445] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.841618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.841686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.841910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.842017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.842115] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 already deleted. [ 856.842197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.842385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.842546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.842629] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.889191] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65ce3e97-db41-488c-9988-1959f1dc1965: rpc.has_security_group_logging(os_id): False [ 856.916173] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.916321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.916396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.917149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.917149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.917149] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.917149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.917149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.917486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.917486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.917486] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65ce3e97-db41-488c-9988-1959f1dc1965 is going to be created. [ 856.989097] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.989246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.989755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.989755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.989755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.001717] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65ce3e97-db41-488c-9988-1959f1dc1965 in Status: IN_PROGRESS for 2s [ 857.075942] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.081197] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.081350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.081460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.081776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.082093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.082236] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.082356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.082474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.082578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.082661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.082778] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 is going to be deleted. [ 857.119233] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.119389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.119445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.119718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.119812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.119917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.120083] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.120230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.120398] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.120517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.120586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.120728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.120802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.120897] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0b01f8-8bd3-45e7-8856-ceefb328f253',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.249945] env[61538]: INFO networking_nsxv3.common.synchronization [req-92e92fa3-e10b-4e85-b30e-f5a8ee2396e6 req-8142ed1f-5fe6-46b0-b65f-c5b99a634931 tempest-AttachInterfacesV270Test-504789276 tempest-AttachInterfacesV270Test-504789276-project-member] Enqueued Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGHEST for action security_group_members [ 857.250508] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGHEST for action security_group_members [ 857.251330] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a08667b0-f29d-4bd2-8394-b73a26086238 with Priority: HIGH for action port [ 857.251330] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGH for action security_group_rules [ 857.251330] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGH for action security_group_rules [ 857.251330] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11683c57-c820-44f9-8374-c60833d4038c with Priority: HIGH for action security_group_rules [ 857.251330] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGH for action security_group_rules [ 857.251330] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc67a55-ecea-4935-9926-a0733e53d126 with Priority: HIGH for action security_group_rules [ 857.251655] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac90853-4d65-407f-8da6-b4b200fba904 with Priority: HIGH for action security_group_rules [ 857.251655] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGH for action security_group_rules [ 857.251655] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGH for action security_group_rules [ 857.251655] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGH for action security_group_rules [ 857.251887] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 with Priority: HIGH for action security_group_rules [ 857.251887] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGH for action security_group_rules [ 857.251887] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGH for action security_group_rules [ 857.252117] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a6fa36-755e-48b1-ab72-10594e3701ad with Priority: HIGH for action security_group_rules [ 857.252117] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 with Priority: HIGH for action security_group_rules [ 857.252241] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 with Priority: HIGH for action security_group_rules [ 857.252241] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGH for action security_group_rules [ 857.252449] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGH for action security_group_rules [ 857.252449] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGH for action security_group_rules [ 857.252449] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGH for action security_group_rules [ 857.252748] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-60e126c8-91fd-48ea-83dd-501de69e291d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.252866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.252923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.253198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.253625] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.253752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.253966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.253966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.254107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.254191] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60e126c8-91fd-48ea-83dd-501de69e291d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.257780] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a08667b0-f29d-4bd2-8394-b73a26086238 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.257780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.257780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.258164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.258269] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a08667b0-f29d-4bd2-8394-b73a26086238',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.259177] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.259291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.259355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.259511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.259584] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.260406] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.260533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.260591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.260710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.260778] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.261887] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11683c57-c820-44f9-8374-c60833d4038c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.261998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.262080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.262316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.262416] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11683c57-c820-44f9-8374-c60833d4038c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.265068] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.265068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.265068] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fc67a55-ecea-4935-9926-a0733e53d126 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.265068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.265068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.265068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.265068] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fc67a55-ecea-4935-9926-a0733e53d126',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.265579] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dac90853-4d65-407f-8da6-b4b200fba904 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.265579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.265579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.265579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.265793] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dac90853-4d65-407f-8da6-b4b200fba904',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.266757] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.267089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.267089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.267089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.267278] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.267656] env[61538]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 857.274362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.274362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.274362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.274362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.274362] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.274362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.274362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.275195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.275195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.275195] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.279134] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850cf150-e9b7-4aa9-8141-ddd003b7e560 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.279293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.279371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.279591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.279694] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850cf150-e9b7-4aa9-8141-ddd003b7e560',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.281835] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.281960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.282039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.282215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.282320] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.283334] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.283522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.283754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3a6fa36-755e-48b1-ab72-10594e3701ad taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.283888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.283971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.284158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.284232] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3a6fa36-755e-48b1-ab72-10594e3701ad',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.285900] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.286014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.286055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.286223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.286296] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea2928f0-ca1a-4287-ba3e-ef5db6d0b393',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.291684] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a503fb1-ef80-462f-8967-ba77e7b55111 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.291684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.291684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.291684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.291684] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a503fb1-ef80-462f-8967-ba77e7b55111',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.291684] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.291684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.291684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.291988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.291988] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.293215] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.293321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.293385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.293545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.293632] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.294777] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.294878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.294943] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.295425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.295531] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.295729] env[61538]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 857.296863] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.296971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.297054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.297867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.297867] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.301887] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.302020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.302020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.302256] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.302427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.302559] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.302624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.303819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.303819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.303819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.303819] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60e126c8-91fd-48ea-83dd-501de69e291d already deleted. [ 857.303819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.304071] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a08667b0-f29d-4bd2-8394-b73a26086238 with status ACTIVE [ 857.304194] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.304292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.304357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.304500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.305157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.305157] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.305157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.305157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.305346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.305346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.305867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.306076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.306309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.306509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.306616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.306710] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a08667b0-f29d-4bd2-8394-b73a26086238 is going to be updated. [ 857.309677] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.309802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.309858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.310962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.310962] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.310962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.310962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.310962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.310962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.310962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.310962] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.340017] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.340017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.340017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.341129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.341129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.341129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a08667b0-f29d-4bd2-8394-b73a26086238" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.367030] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.367030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.367030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.367030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.367030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.367385] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 already deleted. [ 857.367385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.578173] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.623380] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.623614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.623657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.623908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.624091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.624267] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.624488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.624595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.624765] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.624889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.625014] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 already deleted. [ 857.625123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.625245] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc0b01f8-8bd3-45e7-8856-ceefb328f253',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.627457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.627737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.628067] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.628268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.628396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.628662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.629452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.629651] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0b01f8-8bd3-45e7-8856-ceefb328f253',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.819081] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: SUCCESS [ 857.819081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.819370] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.819573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.819682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.819975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.820929] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.820929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.820929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.820929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.820929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.820929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.821838] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.821966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.822077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.822324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.822563] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.822698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.822792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.823035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.823214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.823263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.823676] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.824995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.825467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.825623] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.837435] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.837435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.837435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.837770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.837867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.837961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.838075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.840490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.840490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.840490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.840490] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.845691] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.845851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.845851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.847167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.847270] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.847349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.847405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.847612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.847825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.847825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.847945] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.851658] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.851658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.851658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.851658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.851658] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.851658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.851658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.852180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.852180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.852180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.852180] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.853019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.858010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.858532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.858532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.858998] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.858998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.858998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.858998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.858998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.859524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.859524] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.866754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.867633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.867633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.867633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.869476] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.869476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.869476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.869476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.869476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.869476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.869476] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.872401] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.872650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.872650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.872865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.873269] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.873269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.873374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.873509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.873607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.873680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.873777] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.877995] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.878263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.878263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.878563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.878878] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.878963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.879076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.879330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.879478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.879606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.879690] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.880776] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.881090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.881090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.881204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.881373] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.881518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.881589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.881878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.881878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.881990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.882078] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.926713] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.926918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.926994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.927264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.929819] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.929982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.930791] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.930920] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.931781] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.931866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.932570] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.932655] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.933477] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.933570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.934641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.934734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.936186] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.936296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.960394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.960573] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850cf150-e9b7-4aa9-8141-ddd003b7e560 is going to be deleted. [ 857.961589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.961835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.988337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.988469] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea2928f0-ca1a-4287-ba3e-ef5db6d0b393 is going to be deleted. [ 857.989807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.990107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.012935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.013104] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a503fb1-ef80-462f-8967-ba77e7b55111 is going to be deleted. [ 858.014152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.014387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.036367] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.036606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.037729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.037864] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11683c57-c820-44f9-8374-c60833d4038c is going to be deleted. [ 858.042242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.042242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.062551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.062704] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dac90853-4d65-407f-8da6-b4b200fba904 is going to be deleted. [ 858.063772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.064038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.073463] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.073750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.080490] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.080716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.080779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.081119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.081270] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.081399] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 is going to be updated. [ 858.107906] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.108646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.110105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.110368] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fc67a55-ecea-4935-9926-a0733e53d126 is going to be deleted. [ 858.112856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.113325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.115779] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.116189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.132415] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc0b01f8-8bd3-45e7-8856-ceefb328f253',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.134502] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.134502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.161331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.161492] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3a6fa36-755e-48b1-ab72-10594e3701ad is going to be deleted. [ 858.163425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.163780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.168465] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.168465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.168465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.168465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.168465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.201652] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: IN_PROGRESS for 2s [ 858.217569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.217732] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be deleted. [ 858.218907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.219138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.219253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.219367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850cf150-e9b7-4aa9-8141-ddd003b7e560" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.219552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.219715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.219804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.219918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a503fb1-ef80-462f-8967-ba77e7b55111" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.221292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.221292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.221292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.221469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea2928f0-ca1a-4287-ba3e-ef5db6d0b393" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.221525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.221668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.221884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.221884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11683c57-c820-44f9-8374-c60833d4038c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.222061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.222877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.222877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.222877] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.222877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.222877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.222877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.223180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.223180] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 already deleted. [ 858.223180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.240900] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.240900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.241171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.241207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.241427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.241427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fc67a55-ecea-4935-9926-a0733e53d126" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.249190] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.249190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.249190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.249190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.249190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.249190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dac90853-4d65-407f-8da6-b4b200fba904" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.271143] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: SUCCESS [ 858.271143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.271143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.271143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.271519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.271806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.271969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.272248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.272425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.272608] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.276508] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 858.276508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.276508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.276508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.276508] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.276508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.276508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.277226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.277573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.277814] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.289357] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.290442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.290442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.290442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.290442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.290442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3a6fa36-755e-48b1-ab72-10594e3701ad" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.332456] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3245ba1b-68f2-4ade-b795-a712f120d8b1: rpc.has_security_group_logging(os_id): False [ 858.334093] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.334312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.343413] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.345761] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.345761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.345951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.346096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.346096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.346241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.363570] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.363816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.363816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.364010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.383677] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.383958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.383958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.384232] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.384300] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.384407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.384477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.384647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.384737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.384828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.384978] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.386733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.386827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.387151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.387460] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.387587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.387683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.387782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.387866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.387951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.388055] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.389688] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.389840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.389907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.390351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.390351] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.390351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.390351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.391213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.391213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.391213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.391213] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.391213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.391213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.391213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.391568] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.391568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.391568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.391568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.392468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.392468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.392468] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.393511] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.394555] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.394813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.394813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.395112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.395112] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.395303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.395303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.398207] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.398207] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.398207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.398207] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.399363] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.400473] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.400623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.400623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.400916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.401120] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.401225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.401282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.401435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.401543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.401596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.404026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.404026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.404026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.404026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.404026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.404026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.404026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.404026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.404026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.404026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.404026] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.405241] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.405241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.405388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.405526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.405800] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.405923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.406018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.406157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.406240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.406626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.406837] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.406963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.407075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.407162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.407286] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.407422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.408030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.408233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.408339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.408427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.408511] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.423274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.423463] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.423612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.423831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.423914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.423914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.424155] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.424325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.424513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.424685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.424752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.424966] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.425085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.425188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.425302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.425387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.425622] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 is going to be updated. [ 858.481089] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-995 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.481921] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-995" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.482174] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-995" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.482633] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-995" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.482976] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.483239] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.483458] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.483719] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.483927] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.484806] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.484806] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.484972] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.485326] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.485501] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.485735] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.485970] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.522723] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.523732] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 858.524149] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.524541] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-995" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.524969] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-3f455c93-7dce-4d43-b98a-ed7d25682f00 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.525248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-3f455c93-7dce-4d43-b98a-ed7d25682f00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.525504] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-3f455c93-7dce-4d43-b98a-ed7d25682f00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.525965] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-3f455c93-7dce-4d43-b98a-ed7d25682f00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.526226] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f455c93-7dce-4d43-b98a-ed7d25682f00',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.542135] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.543029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.543162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.543475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.543686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.568307] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: IN_PROGRESS for 2s [ 858.635995] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc0b01f8-8bd3-45e7-8856-ceefb328f253: rpc.has_security_group_logging(os_id): False [ 858.664350] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.664572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.664572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.664856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.664856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.665082] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.665185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.665247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.666051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.666051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.666051] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 is going to be created. [ 858.688534] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cc0b01f8-8bd3-45e7-8856-ceefb328f253], does not exist path=[/infra/domains/default/groups/cc0b01f8-8bd3-45e7-8856-ceefb328f253]."\n}' [ 858.690498] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc0b01f8-8bd3-45e7-8856-ceefb328f253 [ 858.690736] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 858.724850] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.725078] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.725277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.725482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.726411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.726764] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.726877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.727016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.727345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.727487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.727890] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.727986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.728034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.728237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.728345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.728477] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc0b01f8-8bd3-45e7-8856-ceefb328f253 is going to be created. [ 858.752144] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cc0b01f8-8bd3-45e7-8856-ceefb328f253], does not exist path=[/infra/domains/default/groups/cc0b01f8-8bd3-45e7-8856-ceefb328f253]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc0b01f8-8bd3-45e7-8856-ceefb328f253 [ 858.752352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc0b01f8-8bd3-45e7-8856-ceefb328f253" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.752910] env[61538]: Traceback (most recent call last): [ 858.752978] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 858.752978] env[61538]: return func(*args, **kwargs) [ 858.752978] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 858.752978] env[61538]: res.raise_for_status() [ 858.752978] env[61538]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 858.752978] env[61538]: raise HTTPError(http_error_msg, response=self) [ 858.752978] env[61538]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc0b01f8-8bd3-45e7-8856-ceefb328f253 [ 858.752978] env[61538]: During handling of the above exception, another exception occurred: [ 858.752978] env[61538]: Traceback (most recent call last): [ 858.752978] env[61538]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 858.752978] env[61538]: listener.cb(fileno) [ 858.752978] env[61538]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 858.752978] env[61538]: result = function(*args, **kwargs) [ 858.752978] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 858.752978] env[61538]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 858.752978] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 858.752978] env[61538]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 858.752978] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 858.752978] env[61538]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 858.752978] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 858.752978] env[61538]: res.raise_for_status() [ 858.752978] env[61538]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 858.752978] env[61538]: raise HTTPError(http_error_msg, response=self) [ 858.752978] env[61538]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc0b01f8-8bd3-45e7-8856-ceefb328f253 [ 858.752978] env[61538]: Removing descriptor: 23 [ 858.780988] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.782536] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.846544] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff: rpc.has_security_group_logging(os_id): False [ 858.870351] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.870706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.870706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.871335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.895988] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b: rpc.has_security_group_logging(os_id): False [ 858.905799] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8feb07e8-1e39-437e-8497-dad4b8420d11: rpc.has_security_group_logging(os_id): False [ 858.905799] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fcbd20b-13e3-44c4-bf9a-746a1da000dc: rpc.has_security_group_logging(os_id): False [ 858.906620] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 550dcd2b-7021-4904-a80d-13c93ea25fe6: rpc.has_security_group_logging(os_id): False [ 858.909518] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e4fbaf8-8019-44da-bb3b-478c3b16eb47: rpc.has_security_group_logging(os_id): False [ 858.909518] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87950fcb-64a8-4442-9ae9-01d668ddee9e: rpc.has_security_group_logging(os_id): False [ 858.912915] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc1293ec-0409-4faf-afb6-bd4a0b1e16ab: rpc.has_security_group_logging(os_id): False [ 858.930173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.930811] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.930965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.931056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.931338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.932025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.932025] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff is going to be updated. [ 858.933942] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.934240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.934715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.935128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.937350] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.937577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.938479] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.938634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.939454] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.939612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.941184] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.941350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.942125] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.942396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.943155] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.945049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.966968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.967995] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.967995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.967995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.967995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.970018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.970018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.970018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.970018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.970018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.970018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.970018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.970018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.970018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.970018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.970018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.970018] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 858.971630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.971921] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.994919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.995321] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.995498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.995562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.995781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.995868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.996203] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.996288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.996345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.996597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.996705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.996953] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.997057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.997123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.997459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.997459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.997459] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 858.998588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.998780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.019834] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65ce3e97-db41-488c-9988-1959f1dc1965 in Status: SUCCESS [ 859.020085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.021290] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.021394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.027907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.028161] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.028276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.028344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.028540] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.028859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.028859] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.029064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.029064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.029252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.029742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.029742] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.029742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.029742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.029948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.029948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.030090] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 859.031182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.031356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.032741] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.033085] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.033828] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.033828] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.033828] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.033828] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 3f455c93-7dce-4d43-b98a-ed7d25682f00 not found, creating... [ 859.034452] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.034452] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.034593] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.034794] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.034961] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.035312] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.036139] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.036139] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.036139] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.036139] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.036310] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 3f455c93-7dce-4d43-b98a-ed7d25682f00 is going to be created. [ 859.075243] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.075469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.076915] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.077254] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.077642] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.078220] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.078582] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.078907] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-3f455c93-7dce-4d43-b98a-ed7d25682f00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.080755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.081095] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.081283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.081402] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.081653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.081790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.082104] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.082268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.082389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.082730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.082866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.083143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.083288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.083403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.083679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.083729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.083886] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 859.085427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.085665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.109301] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.109469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.166532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.166532] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.166532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.166532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.166532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.166532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.166532] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be updated. [ 859.167800] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.167800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.167800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.168147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.168147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.169087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.169270] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.169418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.171590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.171712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.225309] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff in Status: IN_PROGRESS for 2s [ 859.226101] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 859.228430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.228750] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.228941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.229022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.229230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.229347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.229413] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e is going to be updated. [ 859.230486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.230660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.230803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.231843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.232015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.232213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.233319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.233493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.263165] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 859.264018] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 859.275459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.275754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.275882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.275942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.276182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.276256] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.280031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.280031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.280031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.280031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.280031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.280031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.280031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.280031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.280031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.280031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.280031] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 is going to be updated. [ 859.284643] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.286718] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.314871] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.315215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.315345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.315701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.316323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.335991] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.336169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.336821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.336821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.336821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.350069] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 859.350724] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: IN_PROGRESS for 2s [ 859.406151] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.406854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.406854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.406854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.406854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.445023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e in Status: IN_PROGRESS for 2s [ 859.446715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.447669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.450020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.450020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.450020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.486382] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: IN_PROGRESS for 2s [ 859.792601] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.792906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.792906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.793759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.793759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.793876] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 is going to be updated. [ 859.795951] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.795951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.795951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.795951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.795951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.795951] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 859.831805] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.831805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.831805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.831805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.831805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.835738] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.835738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.835738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.835738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.835738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.846208] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 859.846208] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: IN_PROGRESS for 2s [ 860.025507] env[61538]: INFO networking_nsxv3.common.synchronization [req-92e92fa3-e10b-4e85-b30e-f5a8ee2396e6 req-9fc61ef1-b75a-4905-b893-8c62dbd5ee7d service nova] Enqueued Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGHEST for action security_group_rules [ 860.025507] env[61538]: INFO networking_nsxv3.common.synchronization [req-92e92fa3-e10b-4e85-b30e-f5a8ee2396e6 req-9fc61ef1-b75a-4905-b893-8c62dbd5ee7d service nova] Enqueued Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGHEST for action security_group_members [ 860.025507] env[61538]: INFO networking_nsxv3.common.synchronization [req-92e92fa3-e10b-4e85-b30e-f5a8ee2396e6 req-9fc61ef1-b75a-4905-b893-8c62dbd5ee7d service nova] Enqueued Resource ID: 3f455c93-7dce-4d43-b98a-ed7d25682f00 with Priority: HIGHEST for action port [ 860.025507] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGHEST for action security_group_rules [ 860.025507] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGHEST for action security_group_members [ 860.025507] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f455c93-7dce-4d43-b98a-ed7d25682f00 with Priority: HIGHEST for action port [ 860.026673] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60e126c8-91fd-48ea-83dd-501de69e291d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.027129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.027362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.027714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.028585] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60e126c8-91fd-48ea-83dd-501de69e291d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.029081] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-60e126c8-91fd-48ea-83dd-501de69e291d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.029322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.029469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.029724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.029960] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.031443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.031443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.031443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.031443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.031443] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60e126c8-91fd-48ea-83dd-501de69e291d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.034518] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f455c93-7dce-4d43-b98a-ed7d25682f00 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.034860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f455c93-7dce-4d43-b98a-ed7d25682f00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.035024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f455c93-7dce-4d43-b98a-ed7d25682f00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.035631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f455c93-7dce-4d43-b98a-ed7d25682f00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.035631] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f455c93-7dce-4d43-b98a-ed7d25682f00',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.214704] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: SUCCESS [ 860.214931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.215122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.215342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.215539] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.215659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.215723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.215870] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.215949] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.216049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.216167] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.217202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.217250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.218225] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.218225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.218225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.218225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.218225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.218225] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.410932] env[61538]: INFO networking_nsxv3.common.synchronization [req-72cc57aa-6d97-4f6b-bcb5-67b10d28b526 req-f5d8d29b-40f2-46f6-bc1b-ad8cc8d4b34c tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 860.411565] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 860.411700] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.411700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.411880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.411962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.414312] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.414523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.414621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.414758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.414858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.414969] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.539599] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-60e126c8-91fd-48ea-83dd-501de69e291d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.539876] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.540217] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60e126c8-91fd-48ea-83dd-501de69e291d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.542662] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f455c93-7dce-4d43-b98a-ed7d25682f00 with status ACTIVE [ 860.542662] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.542662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.542662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.542662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.542662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.542936] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.542936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.542936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.543056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.548187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.548522] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.548653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.548774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.548946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.549069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.549178] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f455c93-7dce-4d43-b98a-ed7d25682f00 is going to be updated. [ 860.584373] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: SUCCESS [ 860.584689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.608940] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.609188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.609188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.609408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.609556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.609751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f455c93-7dce-4d43-b98a-ed7d25682f00" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.720274] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.720484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.720678] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.917404] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.917720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.917720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.917915] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.918015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.918216] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.918483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.918483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.918563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.918607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.918707] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 860.954404] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.954629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.954629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.954820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.954960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.966792] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 861.043398] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60e126c8-91fd-48ea-83dd-501de69e291d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.224699] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.245745] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff in Status: SUCCESS [ 861.245985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.247047] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 861.247047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.279073] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 861.279688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.280986] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 861.280986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.361276] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 861.361276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.363124] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 861.363124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.398894] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1b5b7303-8519-4658-9b5a-6a71c164ec66 None None] Enqueued Resource ID: f34627b1-c06e-4225-bb85-2a5c528ef732 with Priority: HIGHEST for action port [ 861.398894] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f34627b1-c06e-4225-bb85-2a5c528ef732 with Priority: HIGHEST for action port [ 861.398894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f34627b1-c06e-4225-bb85-2a5c528ef732 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.398894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f34627b1-c06e-4225-bb85-2a5c528ef732" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.398894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f34627b1-c06e-4225-bb85-2a5c528ef732" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.401901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f34627b1-c06e-4225-bb85-2a5c528ef732" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.401901] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f34627b1-c06e-4225-bb85-2a5c528ef732',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.459385] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e in Status: SUCCESS [ 861.460061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.510100] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: SUCCESS [ 861.511520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.548431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.548632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.548716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.549179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.549291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.549443] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60e126c8-91fd-48ea-83dd-501de69e291d is going to be created. [ 861.579360] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.579844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.579844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.580152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.581055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.609088] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60e126c8-91fd-48ea-83dd-501de69e291d in Status: UNINITIALIZED for 2s [ 861.733112] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.735707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.735707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.735707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.735707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.735707] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 is going to be updated. [ 861.770901] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.771107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.771161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.771349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.771498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.784386] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: IN_PROGRESS for 2s [ 861.856049] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 861.857515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.859803] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: SUCCESS [ 861.859803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.859803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.863157] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.863157] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.863157] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.863157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.863157] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.866572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.866572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.866572] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.867683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.867683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.867683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.867683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.867683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.867683] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.902888] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f34627b1-c06e-4225-bb85-2a5c528ef732 [ 861.903310] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.903665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.905844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.906224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.906436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.906660] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f34627b1-c06e-4225-bb85-2a5c528ef732 already deleted. [ 861.906835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f34627b1-c06e-4225-bb85-2a5c528ef732" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.275513] env[61538]: INFO networking_nsxv3.common.synchronization [req-1370f1f1-fa12-45ee-bf0f-9bcc022173e6 req-ef08fed1-335f-49fa-ac8e-570430980e17 tempest-MigrationsAdminTest-1836932771 tempest-MigrationsAdminTest-1836932771-project-member] Enqueued Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 862.277104] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 862.279400] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.279400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.279400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.279400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.279400] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.279400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.279400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.279400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.279400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.279400] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.368811] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6798f697-f08e-4d7d-8b6e-6fb13201518f: rpc.has_security_group_logging(os_id): False [ 862.370916] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.390276] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.390438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.390496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.390739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.415316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.415316] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.415316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.415316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.415316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.415316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.415600] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.415600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.415600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.415805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.415900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.416259] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.416420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.416567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.416817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.416938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.417043] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 862.495455] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.495694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.495825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.496700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.496700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.519124] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 862.783937] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.872848] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e844ad3e-80cf-412c-a6ea-015ade97cb73: rpc.has_security_group_logging(os_id): False [ 862.901603] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.901779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.901779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.902077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.935026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.935026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.935026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.935026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.935026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.935026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.935026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 is going to be updated. [ 862.976439] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 862.976852] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 862.977098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.001355] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.001355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.001355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.001355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.001355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.019083] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: IN_PROGRESS for 2s [ 863.211869] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.212088] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.212219] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.212511] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.213949] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.214855] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.215157] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.215645] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.215831] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.216085] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.216211] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.216328] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.216505] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.216577] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.216691] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.216835] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.243329] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.243497] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 863.243648] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.243839] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-880" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.244184] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-fc3b9500-79f7-4be8-a298-f3522507a716 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.244607] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-fc3b9500-79f7-4be8-a298-f3522507a716" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.244756] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-fc3b9500-79f7-4be8-a298-f3522507a716" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.245149] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-fc3b9500-79f7-4be8-a298-f3522507a716" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.245250] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc3b9500-79f7-4be8-a298-f3522507a716',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.263405] env[61538]: INFO networking_nsxv3.common.synchronization [None req-552bf4d7-5e4d-4b83-919a-87c2adf0f9a3 tempest-AttachVolumeShelveTestJSON-1204522908 tempest-AttachVolumeShelveTestJSON-1204522908-project-member] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_rules [ 863.264145] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_rules [ 863.264470] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.264584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.264640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.266070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.266218] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.287496] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.463120] env[61538]: INFO networking_nsxv3.common.synchronization [None req-e7cb5781-3db3-4a13-982b-94650aead785 tempest-AttachVolumeShelveTestJSON-1204522908 tempest-AttachVolumeShelveTestJSON-1204522908-project-member] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_rules [ 863.463778] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_rules [ 863.464903] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.465113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.620445] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60e126c8-91fd-48ea-83dd-501de69e291d in Status: SUCCESS [ 863.620655] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.620817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.621059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.621256] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.621387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.621433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.622534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.622534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.622534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.622534] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60e126c8-91fd-48ea-83dd-501de69e291d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.750139] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.750139] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.750139] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.750436] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.751272] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.751272] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port fc3b9500-79f7-4be8-a298-f3522507a716 not found, creating... [ 863.751272] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.751540] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.751540] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.751772] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.752235] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.752895] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.753629] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.753629] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.753629] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.753862] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.753862] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: fc3b9500-79f7-4be8-a298-f3522507a716 is going to be created. [ 863.780725] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.780725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.780725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.780725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.780725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.780725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-fc3b9500-79f7-4be8-a298-f3522507a716" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.790334] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.790488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.790585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.790821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.790915] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.791036] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ba62abf-b989-4453-9509-66329821ead3 already deleted. [ 863.791134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.791467] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.791572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.791637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.791788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.791866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.791949] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 580370e7-ea25-4027-912b-de772679071c is going to be updated. [ 863.793955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.793955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.793955] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.795712] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: SUCCESS [ 863.795903] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.796068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.797482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.797482] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.797482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.797482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.797482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.797482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.797482] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.829881] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.829971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.830066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.830286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.830456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.841245] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: IN_PROGRESS for 2s [ 864.056302] env[61538]: INFO networking_nsxv3.common.synchronization [None req-8019e364-e6cf-46a2-bf20-dfef17ca6b19 None None] Enqueued Resource ID: 985761bb-86b4-4d4a-a697-1b07d8f80fc9 with Priority: HIGHEST for action port [ 864.056302] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 985761bb-86b4-4d4a-a697-1b07d8f80fc9 with Priority: HIGHEST for action port [ 864.056302] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-985761bb-86b4-4d4a-a697-1b07d8f80fc9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.056302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-985761bb-86b4-4d4a-a697-1b07d8f80fc9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.056302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-985761bb-86b4-4d4a-a697-1b07d8f80fc9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.056302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-985761bb-86b4-4d4a-a697-1b07d8f80fc9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.056302] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('985761bb-86b4-4d4a-a697-1b07d8f80fc9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.124802] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-60e126c8-91fd-48ea-83dd-501de69e291d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.129179] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.129179] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-60e126c8-91fd-48ea-83dd-501de69e291d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.129179] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.129179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.129779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.129779] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60e126c8-91fd-48ea-83dd-501de69e291d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.299887] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.320407] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.320665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.320665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.321890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.322079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.322198] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ba62abf-b989-4453-9509-66329821ead3 already deleted. [ 864.322304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.559554] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 985761bb-86b4-4d4a-a697-1b07d8f80fc9 [ 864.559740] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.559922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.560213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.560433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.560433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.560602] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:985761bb-86b4-4d4a-a697-1b07d8f80fc9 already deleted. [ 864.560602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-985761bb-86b4-4d4a-a697-1b07d8f80fc9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.563918] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 864.564217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.564430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.564767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.564903] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.634592] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60e126c8-91fd-48ea-83dd-501de69e291d: rpc.has_security_group_logging(os_id): False [ 864.657642] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.657807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.657978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.658123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.658226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.658472] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.658555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.658635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.658762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.658863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.659046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.659143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.659217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.659356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.659439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.659641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.659731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.659806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.659944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.660073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.660167] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60e126c8-91fd-48ea-83dd-501de69e291d is going to be created. [ 864.747522] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.747714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.748689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.748852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.751486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.766306] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60e126c8-91fd-48ea-83dd-501de69e291d in Status: IN_PROGRESS for 2s [ 864.805041] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.038097] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: SUCCESS [ 865.038097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.038097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.038097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.038097] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.068552] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.068552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.068552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.070803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.070803] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.070803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.070803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.070803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.070803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.070803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.070803] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.308195] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.308541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.308541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.308856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.308999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.309083] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 is going to be updated. [ 865.346871] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.347086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.347173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.347409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.347596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.361093] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: IN_PROGRESS for 2s [ 865.441491] env[61538]: INFO networking_nsxv3.common.synchronization [req-1370f1f1-fa12-45ee-bf0f-9bcc022173e6 req-e7f55402-6cc8-492c-aaf9-68825401f3e7 service nova] Enqueued Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_rules [ 865.441685] env[61538]: INFO networking_nsxv3.common.synchronization [req-1370f1f1-fa12-45ee-bf0f-9bcc022173e6 req-e7f55402-6cc8-492c-aaf9-68825401f3e7 service nova] Enqueued Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 865.441831] env[61538]: INFO networking_nsxv3.common.synchronization [req-1370f1f1-fa12-45ee-bf0f-9bcc022173e6 req-e7f55402-6cc8-492c-aaf9-68825401f3e7 service nova] Enqueued Resource ID: fc3b9500-79f7-4be8-a298-f3522507a716 with Priority: HIGHEST for action port [ 865.442100] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_rules [ 865.442238] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 865.442333] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc3b9500-79f7-4be8-a298-f3522507a716 with Priority: HIGHEST for action port [ 865.443113] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.443340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.443396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.443685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.443736] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.444711] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.444854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.445182] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc3b9500-79f7-4be8-a298-f3522507a716 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.445266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc3b9500-79f7-4be8-a298-f3522507a716" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.445308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc3b9500-79f7-4be8-a298-f3522507a716" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.445493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc3b9500-79f7-4be8-a298-f3522507a716" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.445571] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc3b9500-79f7-4be8-a298-f3522507a716',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.540902] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.541146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.541247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.541698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.541698] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.541853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.541853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.541977] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.542121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.542204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.542298] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.572847] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.573110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.573110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.573401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.573546] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.573652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.573781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.573893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.573984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.574108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.574275] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.574445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.574445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.574579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.574742] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.574807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.574878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.575062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.575178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.575222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.575285] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.854573] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: SUCCESS [ 865.854773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.854943] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.855228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.855424] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.855544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.855671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.855761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.855924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.855924] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.947209] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.947350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.947522] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc3b9500-79f7-4be8-a298-f3522507a716 with status ACTIVE [ 865.947708] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.947810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.947877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.948157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.948261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.948436] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.948600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.948663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.948888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.949070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.949283] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.949387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.949453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.949612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.949691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.949976] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc3b9500-79f7-4be8-a298-f3522507a716 is going to be updated. [ 865.973586] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.973586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.973586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.973586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.973769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.973807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc3b9500-79f7-4be8-a298-f3522507a716" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.047706] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.080104] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6798f697-f08e-4d7d-8b6e-6fb13201518f: rpc.has_security_group_logging(os_id): False [ 866.102556] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.102701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.103042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.103042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.103175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.103867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.103867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.103867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.103867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.103867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.103867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.104333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.104333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.104333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.104333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.104505] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.104505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.104604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.107099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.107099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.107099] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 866.192676] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.192830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.192904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.193148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.193336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.211849] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 866.363626] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.551443] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e844ad3e-80cf-412c-a6ea-015ade97cb73: rpc.has_security_group_logging(os_id): False [ 866.585040] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.585179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.585221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.585452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.585549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.585782] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.585884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.586020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.586131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.586230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.586363] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 is going to be updated. [ 866.624381] env[61538]: INFO networking_nsxv3.common.synchronization [req-b8a2e8db-814e-4990-bd0e-6833b9e0fd8d req-e908e13e-635a-422d-b3f7-49300392364e tempest-ServerRescueTestJSONUnderV235-989113730 tempest-ServerRescueTestJSONUnderV235-989113730-project-member] Enqueued Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 866.629536] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 with Priority: HIGHEST for action security_group_members [ 866.630182] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.630344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.691240] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.691672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.691672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.691672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.692198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.704912] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: IN_PROGRESS for 2s [ 866.782357] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60e126c8-91fd-48ea-83dd-501de69e291d in Status: SUCCESS [ 866.782562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.868944] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.372631] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.372631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.372631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.372631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.372631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.372631] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 580370e7-ea25-4027-912b-de772679071c is going to be updated. [ 867.374151] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: SUCCESS [ 867.374264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.374484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.376480] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.376480] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.376480] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.376480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.376480] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.379023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.379023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.379023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.379023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.379023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.379023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.379023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.379023] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.406027] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.406027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.406027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.406262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.406301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.417895] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: IN_PROGRESS for 2s [ 867.880486] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fbcfa9e-907b-4758-98b8-3e4aa52eed72: rpc.has_security_group_logging(os_id): False [ 867.883025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.883136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.883136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.883317] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.905365] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.905505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.912732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.913040] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.913173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.913242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.913460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.913611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.913649] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 is going to be updated. [ 867.914997] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.915195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.915283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.915662] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.915740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.915804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.915951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.916039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.916248] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.916343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.916404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.916605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.916693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.916917] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.917031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.917095] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.917241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.917319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.917406] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 is going to be updated. [ 867.954920] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.955102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.955150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.955350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.955488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.964277] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: IN_PROGRESS for 2s [ 868.007407] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.007579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.007716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.009774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.009774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.028286] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: IN_PROGRESS for 2s [ 868.228880] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 868.229123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.229302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.229571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.229696] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.725773] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: SUCCESS [ 868.726729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.732718] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.732865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.733217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.733217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.733338] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.734385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.734385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.734385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.734385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.734385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.734385] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.237196] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.239262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.239414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.239659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.239883] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.240048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.240166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.241806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.241933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.242043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.242248] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.242429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.242547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.242724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.242882] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.242986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.247590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.247884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.248013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.249149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.249317] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.323283] env[61538]: INFO networking_nsxv3.common.synchronization [req-53281cb3-7137-47e7-8a92-6b56675d5776 req-c176b1ae-9dd0-41cd-9d89-4163014b20d2 tempest-ServerRescueTestJSON-824602145 tempest-ServerRescueTestJSON-824602145-project-member] Enqueued Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 869.323901] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 869.324341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.324540] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.324656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.324982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.325263] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.325452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.325564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.326608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.326608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.326608] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.434025] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: SUCCESS [ 869.434025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.434025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.434025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.434025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.434025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.434025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.434025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.434025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.434025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.434025] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.752182] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6798f697-f08e-4d7d-8b6e-6fb13201518f: rpc.has_security_group_logging(os_id): False [ 869.773561] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.773796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.773912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.774241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.774711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.775120] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.775374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.775505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.775818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.775966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.776357] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.776620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.776760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.777086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.777302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.777966] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.778192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.778744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.778744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.778744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.778923] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 869.832451] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.920484] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.921495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.921588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.921818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.921978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.936381] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.936607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.936690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.937046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.937314] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.937438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.937579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.937708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.937794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.937884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.938085] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.938180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.938252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.938391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.938536] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.938620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.938682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.938815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.938910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.938992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.939171] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.941948] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 869.988105] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: SUCCESS [ 869.988340] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 deletion is rescheduled due to dependency. [ 869.988398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.028027] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.028027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-740" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.028027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-740" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.028027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-740" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.028027] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.028027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.028027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.028027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.028027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.028027] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.028027] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.028027] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.028027] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.028938] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.028938] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.028938] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.058689] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 in Status: SUCCESS [ 870.058952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.059197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.059509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.059568] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fbcfa9e-907b-4758-98b8-3e4aa52eed72',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.061490] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.061696] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.061883] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.062129] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-740" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.062471] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-8564beef-15a1-4c85-b090-c45df7394356 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.062667] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-8564beef-15a1-4c85-b090-c45df7394356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.062854] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-8564beef-15a1-4c85-b090-c45df7394356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.063228] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-8564beef-15a1-4c85-b090-c45df7394356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.063410] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8564beef-15a1-4c85-b090-c45df7394356',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.335325] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.441947] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 580370e7-ea25-4027-912b-de772679071c: rpc.has_security_group_logging(os_id): False [ 870.467980] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.468216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.468379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.468947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.501148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.501148] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.501393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.501393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.501854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.501991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.502261] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.502370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.502459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.502668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.502785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.502997] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.503122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.503182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.503319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.503397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.503487] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 580370e7-ea25-4027-912b-de772679071c is going to be updated. [ 870.565823] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.566091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.566185] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.566625] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.566982] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.567211] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 8564beef-15a1-4c85-b090-c45df7394356 not found, creating... [ 870.567666] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.567927] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.568174] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.568539] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.568769] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.569239] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.569485] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.569679] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.570021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.570292] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.570479] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 8564beef-15a1-4c85-b090-c45df7394356 is going to be created. [ 870.588013] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.588341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.588438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.588740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.588992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.595702] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.595957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.596086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.596435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.596650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.596789] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fbcfa9e-907b-4758-98b8-3e4aa52eed72 is going to be deleted. [ 870.617499] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.617845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.618157] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.618338] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.618482] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.618759] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-8564beef-15a1-4c85-b090-c45df7394356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.620242] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 580370e7-ea25-4027-912b-de772679071c in Status: IN_PROGRESS for 2s [ 870.695254] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.695254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.695254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.695254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.695254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.695254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fbcfa9e-907b-4758-98b8-3e4aa52eed72" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.841026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.841026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.841026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.841026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.841026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.841026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 is going to be updated. [ 870.885190] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.885190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.885190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.885190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.885190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.894890] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: IN_PROGRESS for 2s [ 871.459353] env[61538]: INFO networking_nsxv3.common.synchronization [req-b7814f69-2d26-4887-aa98-b1ef7b415726 req-c2dc8a2e-a1fc-447e-9199-e04624e14366 tempest-ListServersNegativeTestJSON-2137231986 tempest-ListServersNegativeTestJSON-2137231986-project-member] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 871.460075] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 871.460312] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.460459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.460546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.460776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.460970] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.461123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.461190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.461286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.461368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.461483] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.710971] env[61538]: INFO networking_nsxv3.common.synchronization [req-33c1e9ba-89c7-41e5-aa42-f73b8937f1ef req-0d521d59-46d2-4599-a85e-ba96e53bbc2e tempest-ListServersNegativeTestJSON-2137231986 tempest-ListServersNegativeTestJSON-2137231986-project-member] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 871.715278] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGHEST for action security_group_members [ 871.715278] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.715278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.926642] env[61538]: INFO networking_nsxv3.common.synchronization [req-53281cb3-7137-47e7-8a92-6b56675d5776 req-dd57fb1f-36ab-4e2b-adf9-1cb6cf4cc24b service nova] Enqueued Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_rules [ 871.926864] env[61538]: INFO networking_nsxv3.common.synchronization [req-53281cb3-7137-47e7-8a92-6b56675d5776 req-dd57fb1f-36ab-4e2b-adf9-1cb6cf4cc24b service nova] Enqueued Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 871.926925] env[61538]: INFO networking_nsxv3.common.synchronization [req-53281cb3-7137-47e7-8a92-6b56675d5776 req-dd57fb1f-36ab-4e2b-adf9-1cb6cf4cc24b service nova] Enqueued Resource ID: 8564beef-15a1-4c85-b090-c45df7394356 with Priority: HIGHEST for action port [ 871.927555] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_rules [ 871.927741] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 871.927851] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8564beef-15a1-4c85-b090-c45df7394356 with Priority: HIGHEST for action port [ 871.928162] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.928289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.928369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.928586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.929045] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.929652] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.929759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.929961] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-8564beef-15a1-4c85-b090-c45df7394356 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.930093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8564beef-15a1-4c85-b090-c45df7394356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.930163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8564beef-15a1-4c85-b090-c45df7394356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.930362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8564beef-15a1-4c85-b090-c45df7394356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.930448] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8564beef-15a1-4c85-b090-c45df7394356',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.960513] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 871.960831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.964641] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.999189] env[61538]: INFO networking_nsxv3.common.synchronization [req-250f27aa-d23d-4451-8868-85110dfc1e1a req-b467d564-0899-4733-8c34-7c4057d2bb0e tempest-ListImageFiltersTestJSON-574044180 tempest-ListImageFiltersTestJSON-574044180-project-member] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 871.999189] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 871.999932] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.999932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.999932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.000160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.000278] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.000355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.000458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.000892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.000892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.000892] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.144234] env[61538]: INFO networking_nsxv3.common.synchronization [req-296778e7-4263-45ba-b8fd-2a4fbf8a0e32 req-aee08d62-374a-48ef-b0b5-6359e0f70702 tempest-ListServerFiltersTestJSON-816069453 tempest-ListServerFiltersTestJSON-816069453-project-member] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 872.144856] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 872.145308] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.145469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.145561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.146495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.146754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.146889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.146998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.147222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.147340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.147461] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.431996] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.432221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.432349] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8564beef-15a1-4c85-b090-c45df7394356 with status ACTIVE [ 872.432523] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.432668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.432790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.432984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.433080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.433730] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.433730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.433730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.433730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.433730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.434252] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.434252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.434252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.434252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.434491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.434491] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8564beef-15a1-4c85-b090-c45df7394356 is going to be updated. [ 872.456487] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.456777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.456861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.457037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.457178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.457401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8564beef-15a1-4c85-b090-c45df7394356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.467659] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.487430] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-417 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.487776] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.487919] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.488261] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.488540] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.488715] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.488840] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.489139] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.489243] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.489443] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.489558] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.489670] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.489779] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.489888] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.490009] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.490261] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.503786] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.512231] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.512453] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 872.512602] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.513782] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.513782] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-52cec3f8-5316-4f38-86e3-82087b8e5fac taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.513782] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-52cec3f8-5316-4f38-86e3-82087b8e5fac" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.513782] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-52cec3f8-5316-4f38-86e3-82087b8e5fac" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.513782] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-52cec3f8-5316-4f38-86e3-82087b8e5fac" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.514185] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cec3f8-5316-4f38-86e3-82087b8e5fac',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.642124] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 580370e7-ea25-4027-912b-de772679071c in Status: SUCCESS [ 872.642124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.650790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.650970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.651025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.651387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.652028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.652028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.652028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.652028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.652328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.652328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.652328] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a already deleted. [ 872.652328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.905722] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: SUCCESS [ 872.905886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.906062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.906287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.906483] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.906641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.906711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.906971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.906971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.907077] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.969584] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.969904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.969904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.969989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.970097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.970202] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 873.003824] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.003973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.004043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.004300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.004434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.005522] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.018196] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.018196] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.018196] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.018196] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.018196] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.018196] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 52cec3f8-5316-4f38-86e3-82087b8e5fac not found, creating... [ 873.018196] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.018718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.018718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.018718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.018920] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.019248] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.019351] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.019431] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.019632] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.019771] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.019912] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 52cec3f8-5316-4f38-86e3-82087b8e5fac is going to be created. [ 873.021574] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 873.049664] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.049921] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.050542] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.050542] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.050721] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.050986] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-52cec3f8-5316-4f38-86e3-82087b8e5fac" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.410316] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.508971] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.509196] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.509246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.513024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.513024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.513024] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 is going to be updated. [ 873.560317] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.560462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.560529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.560830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.561195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.571600] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: IN_PROGRESS for 2s [ 873.868716] env[61538]: INFO networking_nsxv3.common.synchronization [req-296778e7-4263-45ba-b8fd-2a4fbf8a0e32 req-c73bbbac-59f8-406d-9d26-bc52ad6a79b5 service nova] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_rules [ 873.868927] env[61538]: INFO networking_nsxv3.common.synchronization [req-296778e7-4263-45ba-b8fd-2a4fbf8a0e32 req-c73bbbac-59f8-406d-9d26-bc52ad6a79b5 service nova] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 873.869195] env[61538]: INFO networking_nsxv3.common.synchronization [req-296778e7-4263-45ba-b8fd-2a4fbf8a0e32 req-c73bbbac-59f8-406d-9d26-bc52ad6a79b5 service nova] Enqueued Resource ID: 52cec3f8-5316-4f38-86e3-82087b8e5fac with Priority: HIGHEST for action port [ 873.869328] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_rules [ 873.869462] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 873.869556] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cec3f8-5316-4f38-86e3-82087b8e5fac with Priority: HIGHEST for action port [ 873.870413] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.870518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.870518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.870831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.870892] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.872086] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.872209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.872279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.872535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.872605] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.872700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.872764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.872964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.873079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.873175] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.873924] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-52cec3f8-5316-4f38-86e3-82087b8e5fac taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.874052] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52cec3f8-5316-4f38-86e3-82087b8e5fac" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.874142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52cec3f8-5316-4f38-86e3-82087b8e5fac" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.874301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52cec3f8-5316-4f38-86e3-82087b8e5fac" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.874382] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cec3f8-5316-4f38-86e3-82087b8e5fac',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.913174] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.376916] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.377548] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.377548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.382534] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52cec3f8-5316-4f38-86e3-82087b8e5fac with status ACTIVE [ 874.382534] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.382534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.382534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.382534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.382534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.382534] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.382534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.382534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.382534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.382534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.382534] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.382534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.383254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.383254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.383254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.383254] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52cec3f8-5316-4f38-86e3-82087b8e5fac is going to be updated. [ 874.406746] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.406910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.406955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.407181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.407322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.407487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52cec3f8-5316-4f38-86e3-82087b8e5fac" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.415345] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.415493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.415570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.415763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.415851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.415949] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 is going to be updated. [ 874.450316] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.450474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.450588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.451336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.451336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.460769] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: IN_PROGRESS for 2s [ 874.879162] env[61538]: INFO networking_nsxv3.common.synchronization [req-12072cfc-db30-4a70-a510-865d2c16bd8c req-3842b734-7fa0-4b09-8525-f4af1e5cc862 tempest-ListServerFiltersTestJSON-816069453 tempest-ListServerFiltersTestJSON-816069453-project-member] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 874.880043] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 874.880043] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.880273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.880581] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.047889] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 875.048267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.048784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.049269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.049525] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.049687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.049775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.050120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.050261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.050398] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.383026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.383315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.383315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.383608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.383748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.383880] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be created. [ 875.406217] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-417 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.406433] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.406559] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.407317] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.407620] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.407812] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.407944] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.408229] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.408382] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.408638] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.408759] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.408874] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.409014] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.409149] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.409263] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.409402] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.411342] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.411500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.411547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.411731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.411909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.438329] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: UNINITIALIZED for 2s [ 875.442871] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.443214] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 875.443468] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.443770] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.444286] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-14efafb4-97cd-4720-a2dd-36f9af0a8644 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.444709] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-14efafb4-97cd-4720-a2dd-36f9af0a8644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.444936] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-14efafb4-97cd-4720-a2dd-36f9af0a8644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.445445] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-14efafb4-97cd-4720-a2dd-36f9af0a8644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.445698] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14efafb4-97cd-4720-a2dd-36f9af0a8644',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.553338] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.553607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.553607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.553833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.553950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.554184] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.554308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.554372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.554685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.554685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.554759] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be updated. [ 875.593284] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: SUCCESS [ 875.593501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.622776] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.622913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.622913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.623204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.623294] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.643541] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: IN_PROGRESS for 2s [ 875.951656] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.951656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.951656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.951656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.951656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.951656] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 14efafb4-97cd-4720-a2dd-36f9af0a8644 not found, creating... [ 875.951656] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.951656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.951656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.951656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.951656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.952645] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.952645] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.952645] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.952979] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.952979] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.953284] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 14efafb4-97cd-4720-a2dd-36f9af0a8644 is going to be created. [ 875.975927] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.975927] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.975927] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.976180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.976223] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.976488] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-14efafb4-97cd-4720-a2dd-36f9af0a8644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.454915] env[61538]: INFO networking_nsxv3.common.synchronization [req-bf1d0799-5e00-4b9c-9d97-7a0361434199 req-89a41850-cc0e-4969-beda-127b2a1a4111 tempest-AttachInterfacesV270Test-504789276 tempest-AttachInterfacesV270Test-504789276-project-member] Enqueued Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGHEST for action security_group_members [ 876.454915] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGHEST for action security_group_members [ 876.455675] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-60e126c8-91fd-48ea-83dd-501de69e291d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.456024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.456285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.456794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.457254] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.457548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.457765] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.458115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.462739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.462739] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60e126c8-91fd-48ea-83dd-501de69e291d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.485208] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: SUCCESS [ 876.485208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.485208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.485208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.485208] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.485208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.485593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.485593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.486941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.486941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.486941] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.784394] env[61538]: INFO networking_nsxv3.common.synchronization [req-12072cfc-db30-4a70-a510-865d2c16bd8c req-fee25139-d3d8-4879-a4b6-39b620d7ad19 service nova] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_rules [ 876.785876] env[61538]: INFO networking_nsxv3.common.synchronization [req-12072cfc-db30-4a70-a510-865d2c16bd8c req-fee25139-d3d8-4879-a4b6-39b620d7ad19 service nova] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 876.785876] env[61538]: INFO networking_nsxv3.common.synchronization [req-12072cfc-db30-4a70-a510-865d2c16bd8c req-fee25139-d3d8-4879-a4b6-39b620d7ad19 service nova] Enqueued Resource ID: 14efafb4-97cd-4720-a2dd-36f9af0a8644 with Priority: HIGHEST for action port [ 876.786975] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_rules [ 876.786975] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 876.787912] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14efafb4-97cd-4720-a2dd-36f9af0a8644 with Priority: HIGHEST for action port [ 876.788209] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.788605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.788799] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.788971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.789431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-14efafb4-97cd-4720-a2dd-36f9af0a8644 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.789613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14efafb4-97cd-4720-a2dd-36f9af0a8644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.789750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14efafb4-97cd-4720-a2dd-36f9af0a8644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.790310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14efafb4-97cd-4720-a2dd-36f9af0a8644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.790446] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14efafb4-97cd-4720-a2dd-36f9af0a8644',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.971414] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.971414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.971414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.971414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.971414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.971414] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.971414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.971414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.973869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.973869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.973869] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60e126c8-91fd-48ea-83dd-501de69e291d is going to be updated. [ 876.990525] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.990689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.990764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.990986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.992307] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.992307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.992307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.992618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.992618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.992618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.992750] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.992795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.993586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.993586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.993586] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.993586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.993586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.993586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.993930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.993930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.993930] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.011587] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.011779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.011864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.012139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.015032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.023901] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60e126c8-91fd-48ea-83dd-501de69e291d in Status: IN_PROGRESS for 2s [ 877.293469] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14efafb4-97cd-4720-a2dd-36f9af0a8644 with status ACTIVE [ 877.293771] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.293944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.294056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.294355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.294489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.294740] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.294875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.295049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.295161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.295274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.295430] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.295523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.296014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.296014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.296014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.296014] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14efafb4-97cd-4720-a2dd-36f9af0a8644 is going to be updated. [ 877.319305] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.319518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.319518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.319746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.319887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.320066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14efafb4-97cd-4720-a2dd-36f9af0a8644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.458615] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 877.459276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.459276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.459495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.460124] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.460124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.460124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.460671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.460671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.460671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.460671] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.462081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.462081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.462262] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.462340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.462459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.462688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.462822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.462948] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.499043] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8feb07e8-1e39-437e-8497-dad4b8420d11: rpc.has_security_group_logging(os_id): False [ 877.528466] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.530278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.530278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.532310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.532310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.532310] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.532310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.532310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.532310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.532310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.532310] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.532993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.532993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.533161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.533287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.534339] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.534488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.534559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.534773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.534856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.534953] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 is going to be updated. [ 877.632989] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.635357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.635357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.635357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.635357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.665658] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab in Status: SUCCESS [ 877.665874] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab deletion is rescheduled due to dependency. [ 877.666008] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.679028] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: IN_PROGRESS for 2s [ 877.934158] env[61538]: INFO networking_nsxv3.common.synchronization [req-a50c94db-5270-40ac-8dc1-7ae287aeaf0f req-afbf6e0f-8f66-4a4e-b134-6c69e197e412 tempest-ServerActionsTestOtherB-1077210391 tempest-ServerActionsTestOtherB-1077210391-project-member] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 877.934158] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 877.934158] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.934158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.934158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.934158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.934158] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.935179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.935434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.935744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.936018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.936350] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.966636] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.969205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.969205] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.402767] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.402981] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.403128] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.403489] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.403759] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.403920] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.404345] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.404651] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.404855] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.405179] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.405258] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.405392] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.405532] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.405672] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.405807] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.405972] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.428023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.428023] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 878.428023] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.428023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.428263] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.428343] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.428451] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.428822] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.434108] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.439422] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.439638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.439700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.439867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.439999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.440247] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.440403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.440466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.440636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.440777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.440825] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 already deleted. [ 878.440917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.470759] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.936156] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.936156] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.936400] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.937537] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.937537] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.937537] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f not found, creating... [ 878.937537] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.937537] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.937537] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.937950] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.937950] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.938041] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.938864] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.938864] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.938864] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.938864] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.938864] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f is going to be created. [ 878.971119] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.971375] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.971649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.972009] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.972272] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.972508] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.974051] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.974051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.974051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.974276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.974421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.974569] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be updated. [ 879.009759] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.009980] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.010059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.010305] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.010469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.021138] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 879.034133] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60e126c8-91fd-48ea-83dd-501de69e291d in Status: SUCCESS [ 879.034196] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60e126c8-91fd-48ea-83dd-501de69e291d deletion is rescheduled due to dependency. [ 879.034308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.178692] env[61538]: INFO networking_nsxv3.common.synchronization [req-ad68d57a-9fe2-401d-a5c1-744af92527b2 req-4ac5a00d-8422-480f-9f8e-d66b9fcf9c93 tempest-ServersWithSpecificFlavorTestJSON-1598309329 tempest-ServersWithSpecificFlavorTestJSON-1598309329-project-member] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 879.181364] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 879.181364] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.181364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.181364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.181364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.181364] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.181364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.181364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.181364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.181364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.181364] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.684133] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.684531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.684531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.684619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.691941] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: SUCCESS [ 879.692170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.715743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.715743] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.715743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.715743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.715743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.715743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.715743] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e is going to be updated. [ 879.744031] env[61538]: INFO networking_nsxv3.common.synchronization [req-a50c94db-5270-40ac-8dc1-7ae287aeaf0f req-fe1733cc-1014-4aff-80df-1fe87ae3b71c service nova] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 879.744031] env[61538]: INFO networking_nsxv3.common.synchronization [req-a50c94db-5270-40ac-8dc1-7ae287aeaf0f req-fe1733cc-1014-4aff-80df-1fe87ae3b71c service nova] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 879.744031] env[61538]: INFO networking_nsxv3.common.synchronization [req-a50c94db-5270-40ac-8dc1-7ae287aeaf0f req-fe1733cc-1014-4aff-80df-1fe87ae3b71c service nova] Enqueued Resource ID: d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f with Priority: HIGHEST for action port [ 879.745947] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 879.746732] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 879.746732] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f with Priority: HIGHEST for action port [ 879.747289] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.748027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.748027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.748027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.748027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.748972] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.749540] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.749617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.749787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.750220] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.751055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.751188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.751255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.751429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.751581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.751670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.751749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.751897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.752079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.752079] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.754198] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.754907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.755016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.755170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.755567] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.767245] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: IN_PROGRESS for 2s [ 880.257413] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.257725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.257929] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.260810] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f with status ACTIVE [ 880.261256] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.261364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.261364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.263046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.263046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.263046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.263046] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f is going to be updated. [ 880.287100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.287306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.287408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.287948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.288250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.288575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d36c7f3a-2a3b-44a8-bfe6-1af85f921b3f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.760792] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.973705] env[61538]: INFO networking_nsxv3.common.synchronization [req-28f399c6-6add-4f54-87a1-ab381c3f08a9 req-1c4731cd-5978-4e10-b171-52cdf1040132 tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 880.974399] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 880.975833] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.976062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.976062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.976262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.976431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.976531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.976593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.976790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.976880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.976977] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.034754] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 881.034754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.034754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.034937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.035099] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.035214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.035283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.035437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.035521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.035634] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.268519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.268689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.268762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.268981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.269088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.269190] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be created. [ 881.286903] env[61538]: INFO networking_nsxv3.common.synchronization [req-8b5ac43e-7bb3-4d18-9b08-600f948e26f5 req-101cc8de-7212-41b3-9df7-e01d64089fc8 tempest-VolumesAssistedSnapshotsTest-760021604 tempest-VolumesAssistedSnapshotsTest-760021604-project-member] Enqueued Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_members [ 881.287648] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff with Priority: HIGHEST for action security_group_members [ 881.289077] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.289304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.289387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.289717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.289925] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.290244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.290244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.290928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.290928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.290928] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2824e3bd-37f2-4e0d-afe6-4e256a5a8cff',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.299643] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.299858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.299858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.300143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.302471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.313193] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: UNINITIALIZED for 2s [ 881.480072] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.480314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.480386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.480677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.480835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.481112] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.481231] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.481603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.481603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.481603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.481603] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 881.514140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.514140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.514433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.515703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.515913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.525404] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 881.539383] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.780777] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: SUCCESS [ 881.781047] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e deletion is rescheduled due to dependency. [ 881.786339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.795594] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.795750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.796666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.796666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.796666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.796666] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.796666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.796666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.796939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.796939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.797012] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff is going to be updated. [ 881.830136] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.830293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.830369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.830603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.830756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.839648] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff in Status: IN_PROGRESS for 2s [ 882.043423] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.545360] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.545562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.545756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.545847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.545923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.546017] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be updated. [ 882.606974] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.607200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.607200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.607350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.607527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.622522] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 883.323657] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 883.324115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.324115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.324356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.324677] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.324677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.324865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.324923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.325028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.325104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.325178] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.470911] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bc9cf29-faea-4343-b1b7-c3a1b16c400a req-b5cd233a-055f-4d2f-ae80-a254af86c108 tempest-ListServerFiltersTestJSON-816069453 tempest-ListServerFiltersTestJSON-816069453-project-member] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 883.471506] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 883.472544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.472672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.539862] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 883.540111] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b deletion is rescheduled due to dependency. [ 883.540185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.828931] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.852458] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff in Status: SUCCESS [ 883.852651] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2824e3bd-37f2-4e0d-afe6-4e256a5a8cff deletion is rescheduled due to dependency. [ 883.852794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2824e3bd-37f2-4e0d-afe6-4e256a5a8cff" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.270255] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-417 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.270564] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.270626] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.270856] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.271171] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.271284] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.271404] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.271618] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.271770] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.271985] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.273115] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.273263] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.273438] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.273587] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.273727] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.273897] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.295697] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.295864] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.296009] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.296205] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-417" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.296513] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.296717] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.296845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.297196] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.297334] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132b9a92-c7de-4fef-9870-cc4a0a7ae9c2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.331496] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e51a7e95-5364-42cc-944f-ced83c3e81b9: rpc.has_security_group_logging(os_id): False [ 884.349689] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.350034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.350034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.350187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.350271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.350538] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.350642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.350701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.350854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.350994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.351057] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be created. [ 884.424847] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.424938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.424978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.425196] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.425399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.436313] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 884.632039] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 884.632201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.632430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.632662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.632881] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.633031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.633103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.633260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.633346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.633434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.633600] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.633714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.633751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.633866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.634027] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.634132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.634174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.634310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.634399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.634483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.634569] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.635422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.636172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.636172] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.636172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.636172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.636366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.636366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.636366] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.802021] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.802021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.802021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.802021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.802021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.802021] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 132b9a92-c7de-4fef-9870-cc4a0a7ae9c2 not found, creating... [ 884.802021] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.802021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.802021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.802021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.802021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.802583] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.802583] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.802583] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.802583] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.802583] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.802583] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 132b9a92-c7de-4fef-9870-cc4a0a7ae9c2 is going to be created. [ 884.824056] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.824056] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.824056] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.824310] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.824381] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.824667] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.138594] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 563f2c80-ee39-48ef-8436-22a95e9bc54a: rpc.has_security_group_logging(os_id): False [ 885.139775] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.157809] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.158036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.158141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.158290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.158384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.158598] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.158820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.158892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.159094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.159146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.159370] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.159441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.159488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.159600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.159675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.159894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.159948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.160019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.160144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.160259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.160329] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be created. [ 885.217946] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.218126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.218197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.218418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.218649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.233548] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 885.642450] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.784180] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bc9cf29-faea-4343-b1b7-c3a1b16c400a req-4ec0b9f8-678a-428c-902b-d1590a3985fa service nova] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_rules [ 885.784475] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bc9cf29-faea-4343-b1b7-c3a1b16c400a req-4ec0b9f8-678a-428c-902b-d1590a3985fa service nova] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 885.784722] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bc9cf29-faea-4343-b1b7-c3a1b16c400a req-4ec0b9f8-678a-428c-902b-d1590a3985fa service nova] Enqueued Resource ID: 132b9a92-c7de-4fef-9870-cc4a0a7ae9c2 with Priority: HIGHEST for action port [ 885.785649] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_rules [ 885.785807] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 885.785909] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 132b9a92-c7de-4fef-9870-cc4a0a7ae9c2 with Priority: HIGHEST for action port [ 885.786231] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.786341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.786980] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.787108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.787431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.787559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.787642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.787863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.787944] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132b9a92-c7de-4fef-9870-cc4a0a7ae9c2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.147950] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.148205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.148289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.148572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.148720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.148840] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be updated. [ 886.185021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.185241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.185348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.185678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.185863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.196470] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 886.249011] env[61538]: INFO networking_nsxv3.common.synchronization [req-5959a7f0-a39f-416f-92ee-1f612b497dc7 req-1dfcdfd7-3cdc-4767-b729-6b7e22991087 tempest-ServersAdminTestJSON-1231961305 tempest-ServersAdminTestJSON-1231961305-project-member] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 886.249573] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 886.249917] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.250184] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.250922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.250922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.250922] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.250922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.250922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.251187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.251653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.251653] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.290859] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 132b9a92-c7de-4fef-9870-cc4a0a7ae9c2 with status ACTIVE [ 886.290859] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.290859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.290859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.291123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.291123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.291255] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.291358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.291420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.291595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.291692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.291835] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.292033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.292033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.292161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.292208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.292259] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 132b9a92-c7de-4fef-9870-cc4a0a7ae9c2 is going to be updated. [ 886.320543] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.320735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.320871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.320967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.321121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.321297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-132b9a92-c7de-4fef-9870-cc4a0a7ae9c2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.449888] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 886.450151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.754763] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.920425] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.920629] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.920759] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.921045] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.924410] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.928125] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.928125] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.928125] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.928125] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.928125] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.928125] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.928125] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.928125] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.928125] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.928125] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.928125] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.948015] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.951877] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 886.951877] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.951877] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.951877] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-a63c04a1-28a0-46f2-a336-ab01754e90b6 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.951877] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-a63c04a1-28a0-46f2-a336-ab01754e90b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.951877] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-a63c04a1-28a0-46f2-a336-ab01754e90b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.951877] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-a63c04a1-28a0-46f2-a336-ab01754e90b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.951877] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a63c04a1-28a0-46f2-a336-ab01754e90b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.247568] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 887.247568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.247568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.247568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.247568] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.257655] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.454409] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.454815] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.454996] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.455311] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.455476] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.455642] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port a63c04a1-28a0-46f2-a336-ab01754e90b6 not found, creating... [ 887.455969] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.456194] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.456340] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.456606] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.456813] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.457191] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.457358] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.457477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.457713] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.457881] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.458069] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: a63c04a1-28a0-46f2-a336-ab01754e90b6 is going to be created. [ 887.479937] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.480253] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.480391] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.480692] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.480925] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.481222] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-a63c04a1-28a0-46f2-a336-ab01754e90b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.748915] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.749069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.759774] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.760199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.760199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.760395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.760552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.760711] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 887.803886] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.804086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.804160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.804380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.804539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.823651] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 888.208410] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 888.208410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.208410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.209226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.209226] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.209226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.209226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.209226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.209472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.209472] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.388162] env[61538]: INFO networking_nsxv3.common.synchronization [req-5959a7f0-a39f-416f-92ee-1f612b497dc7 req-8a48b846-872c-4b80-a53a-d8a59f68bffa service nova] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_rules [ 888.388417] env[61538]: INFO networking_nsxv3.common.synchronization [req-5959a7f0-a39f-416f-92ee-1f612b497dc7 req-8a48b846-872c-4b80-a53a-d8a59f68bffa service nova] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 888.388608] env[61538]: INFO networking_nsxv3.common.synchronization [req-5959a7f0-a39f-416f-92ee-1f612b497dc7 req-8a48b846-872c-4b80-a53a-d8a59f68bffa service nova] Enqueued Resource ID: a63c04a1-28a0-46f2-a336-ab01754e90b6 with Priority: HIGHEST for action port [ 888.389210] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_rules [ 888.389367] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 888.389514] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63c04a1-28a0-46f2-a336-ab01754e90b6 with Priority: HIGHEST for action port [ 888.389888] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.389973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.390039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.390296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.390349] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.391567] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.391677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.391906] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a63c04a1-28a0-46f2-a336-ab01754e90b6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.393109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a63c04a1-28a0-46f2-a336-ab01754e90b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.393109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a63c04a1-28a0-46f2-a336-ab01754e90b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.393109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a63c04a1-28a0-46f2-a336-ab01754e90b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.393109] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a63c04a1-28a0-46f2-a336-ab01754e90b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.713162] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.896682] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.896682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.896682] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a63c04a1-28a0-46f2-a336-ab01754e90b6 with status ACTIVE [ 888.896682] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.896682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.896682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.896682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.896682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.896682] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.896682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.896682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.896682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.896682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.896682] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.897630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.897630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.897630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.897630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.897630] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a63c04a1-28a0-46f2-a336-ab01754e90b6 is going to be updated. [ 888.923473] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.923473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.923473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.923473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.923473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.923473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a63c04a1-28a0-46f2-a336-ab01754e90b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.214703] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.603759] env[61538]: INFO networking_nsxv3.common.synchronization [req-f70ff8fa-637e-4c99-87b4-40dc837a11c0 req-f3cdaa1b-8e66-42db-8684-e76d28ed80fb tempest-MultipleCreateTestJSON-1583574743 tempest-MultipleCreateTestJSON-1583574743-project-member] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 889.604499] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 889.604870] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.605026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.605149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.605353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.605519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.605645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.605716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.605872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.605981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.606096] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.717754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.718446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.719246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.719481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.719573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.719677] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be updated. [ 889.748567] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.748745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.748745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.748945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.749104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.758199] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 889.833950] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 889.834201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.834656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.834656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.834823] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.835024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.835024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.835125] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.835192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.835286] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.112037] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.112037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.112037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.112037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.112037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.112037] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.112037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.112037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.112037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.112037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.112037] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be deleted. [ 890.146105] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.146256] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.146334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.146544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.146639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.146758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.293752] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-306 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.293894] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.293969] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.294273] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.295049] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.295049] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.295049] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.295804] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.295804] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.295804] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.295804] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.295804] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.296099] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.296099] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.296099] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.296321] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.322467] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.322723] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.322908] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.323206] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.323597] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.323821] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.323998] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.324387] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.324812] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04fca3a-1fcc-4b30-b0e7-83c25fe97200',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.337442] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.828578] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.828742] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.828924] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.829298] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.829485] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.829656] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port d04fca3a-1fcc-4b30-b0e7-83c25fe97200 not found, creating... [ 890.829955] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.830126] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.830255] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.830524] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.830671] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.830988] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.831169] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.831286] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.831499] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.831656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.831808] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: d04fca3a-1fcc-4b30-b0e7-83c25fe97200 is going to be created. [ 890.840368] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.856458] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.856787] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.856913] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.858257] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.858257] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.858257] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.345474] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.345474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.345474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.345474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.345474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.345474] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 891.375273] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.378139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.378139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.378139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.378139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.389157] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 891.771030] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 891.771030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.771030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.771030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.771030] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.771030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.771662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.771662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.771662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.771662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.771662] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.055026] env[61538]: INFO networking_nsxv3.common.synchronization [req-f70ff8fa-637e-4c99-87b4-40dc837a11c0 req-64405968-ce59-433d-981e-b62df82a91ba service nova] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_rules [ 892.055026] env[61538]: INFO networking_nsxv3.common.synchronization [req-f70ff8fa-637e-4c99-87b4-40dc837a11c0 req-64405968-ce59-433d-981e-b62df82a91ba service nova] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 892.055026] env[61538]: INFO networking_nsxv3.common.synchronization [req-f70ff8fa-637e-4c99-87b4-40dc837a11c0 req-64405968-ce59-433d-981e-b62df82a91ba service nova] Enqueued Resource ID: d04fca3a-1fcc-4b30-b0e7-83c25fe97200 with Priority: HIGHEST for action port [ 892.055026] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_rules [ 892.055026] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 892.055026] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d04fca3a-1fcc-4b30-b0e7-83c25fe97200 with Priority: HIGHEST for action port [ 892.055026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.055026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.055026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.055450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.055450] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.056103] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.056215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.056282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.056438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.056582] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.056674] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.056745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.056898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.056994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.057097] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.061165] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.062219] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.062387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.062675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.062852] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04fca3a-1fcc-4b30-b0e7-83c25fe97200',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.277392] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.277392] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.277392] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.277392] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.277392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.278079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.278079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.278079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.278079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.278079] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.564664] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.565787] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.565942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.566335] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d04fca3a-1fcc-4b30-b0e7-83c25fe97200 with status ACTIVE [ 892.566510] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.566618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.566683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.566932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.567088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.567215] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.567313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.567375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.567526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.567600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.567823] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.567915] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.567981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.568139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.568209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.568294] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d04fca3a-1fcc-4b30-b0e7-83c25fe97200 is going to be updated. [ 892.594354] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.594589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.594589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.594902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.595132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.595607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d04fca3a-1fcc-4b30-b0e7-83c25fe97200" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.779817] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 563f2c80-ee39-48ef-8436-22a95e9bc54a: rpc.has_security_group_logging(os_id): False [ 892.798241] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.798652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.798652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.798652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.798857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.799154] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.799154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.799281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.799389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.799464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.803029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.803029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.803029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.803029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.803029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.803029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.803029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.803029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.803029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.803029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.803029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be updated. [ 892.865800] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.866031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.866113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.866308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.866538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.879745] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 893.067573] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.400926] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 893.401093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.401269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.401492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.401688] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.401808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.401913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.402134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.402252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.402350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.402554] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.570034] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.570034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.570034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.570500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.570500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.570500] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be created. [ 893.600639] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.600962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.600962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.601105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.601267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.626556] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: UNINITIALIZED for 2s [ 893.905423] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.905613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.905657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.906172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.906172] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.906268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.906341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.906546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.906810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.906922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.907057] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.907197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.907281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.907454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.907624] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.907763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.907841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.908035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.908115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.908300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.908696] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.422906] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e4fbaf8-8019-44da-bb3b-478c3b16eb47: rpc.has_security_group_logging(os_id): False [ 894.445132] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.445132] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.445132] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.445132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.445718] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.445718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.445718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.445961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.447458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.447602] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 894.519814] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.519814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.519814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.519814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.519814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.535085] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 894.712138] env[61538]: INFO networking_nsxv3.common.synchronization [req-f70ff8fa-637e-4c99-87b4-40dc837a11c0 req-9c684480-1dcd-408c-904c-28496fd3ee3e tempest-MultipleCreateTestJSON-1583574743 tempest-MultipleCreateTestJSON-1583574743-project-member] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 894.713946] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 894.714538] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.715268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.895169] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 894.895409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.895555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.895785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.895876] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.398300] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.398490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.400124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.400124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.400124] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.400124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.400124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.400124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.400124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.400124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.400124] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.637071] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 895.637291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.637467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.637720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.637911] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.638053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.638178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.638390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.638390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.638551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.638551] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.639775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.639958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.640141] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.640260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.640350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.640544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.640544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.640680] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.647826] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-306 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.648056] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.648384] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.648631] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.648848] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.648939] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.648994] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.649481] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.649801] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.650046] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.650159] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.650274] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.650387] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.650501] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.650608] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.650827] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.672360] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.672360] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 895.672360] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.672360] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-306" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.672360] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.672360] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.672360] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.672968] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.672968] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.901540] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.901827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.901827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.902017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.902196] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.902318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.902391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.902547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.902633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.902730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.902865] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.902952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.903015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.903150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.903467] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.903467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.903467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.903616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.903616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.903714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.903787] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.142644] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.142857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.142984] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.175971] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.176337] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.176920] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.177315] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.177495] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.177662] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7 not found, creating... [ 896.178070] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.178384] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.178564] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.178789] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.178973] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.179508] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.179722] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.179820] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.180046] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.180224] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.180384] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7 is going to be created. [ 896.210484] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.210766] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.210921] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.211367] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.211595] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.211839] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.406841] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 563f2c80-ee39-48ef-8436-22a95e9bc54a: rpc.has_security_group_logging(os_id): False [ 896.433411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.433957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.433957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.433957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.433957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.434275] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.434275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.434415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.434725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.434877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.435046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.435271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.435371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.435537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.435635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.435903] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.436038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.436038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.436148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.436209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.436297] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be updated. [ 896.526397] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.526521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.526642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.527274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.527274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.547506] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 896.554788] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 896.555030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.645167] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.148035] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.148035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.148035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.148462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.148462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.148462] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 897.178227] env[61538]: INFO networking_nsxv3.common.synchronization [req-f70ff8fa-637e-4c99-87b4-40dc837a11c0 req-8f43f6b8-9084-4327-80ca-30c89ab8ec4e service nova] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_rules [ 897.178460] env[61538]: INFO networking_nsxv3.common.synchronization [req-f70ff8fa-637e-4c99-87b4-40dc837a11c0 req-8f43f6b8-9084-4327-80ca-30c89ab8ec4e service nova] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 897.178610] env[61538]: INFO networking_nsxv3.common.synchronization [req-f70ff8fa-637e-4c99-87b4-40dc837a11c0 req-8f43f6b8-9084-4327-80ca-30c89ab8ec4e service nova] Enqueued Resource ID: 053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7 with Priority: HIGHEST for action port [ 897.180355] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.180355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.180355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.180355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.180355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.181788] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_rules [ 897.181788] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 897.181788] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7 with Priority: HIGHEST for action port [ 897.182032] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.182126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.182334] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.182423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.182608] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.182756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.182822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.183013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.183094] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.193571] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 897.685665] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7 with status ACTIVE [ 897.685943] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.686211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.686211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.686669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.686669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.686669] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.686875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.686875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.687060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.687147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.687364] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.687604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.687604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.687702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.687747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.687821] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7 is going to be updated. [ 897.721883] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.722096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.722386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.725581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.727477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.727477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-053e08f5-fcde-42f0-ad1c-6a22a6f1ceb7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.562938] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 898.563333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.643357] env[61538]: INFO networking_nsxv3.common.synchronization [req-53908c30-200b-4fd0-a59b-65e606773ba6 req-c306082c-1095-4fbe-9751-117a52573676 tempest-ServerActionsV293TestJSON-1352632226 tempest-ServerActionsV293TestJSON-1352632226-project-member] Enqueued Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_members [ 898.644117] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365fd2af-187a-43da-9017-8bc6e06e1910 with Priority: HIGHEST for action security_group_members [ 898.644547] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-365fd2af-187a-43da-9017-8bc6e06e1910 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.644776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.645098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.645144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.645382] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.645548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.645647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.645878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.646034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.646182] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365fd2af-187a-43da-9017-8bc6e06e1910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.151351] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.151351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.151351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.151351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.174347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.174738] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.174852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.174852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.175081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.175221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.175338] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365fd2af-187a-43da-9017-8bc6e06e1910 is going to be updated. [ 899.204281] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 899.204281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.204610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.204691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.204999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.205180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.205284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.205497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.205607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.205725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.205975] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.206320] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.206468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.206712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.207052] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.207281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.207412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.207649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.208955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.208955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.208955] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.214862] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.215045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.215130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.215358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.215504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.217349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.217349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.217349] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.217349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.217681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.217681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.217835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.217974] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.228482] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365fd2af-187a-43da-9017-8bc6e06e1910 in Status: IN_PROGRESS for 2s [ 899.715162] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 794d6c9f-f896-426d-a29e-0a532c759616: rpc.has_security_group_logging(os_id): False [ 899.720344] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.736337] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.736515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.736585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.736824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.736931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.737212] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.737292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.737346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.737466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.737542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.738083] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.738219] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.738277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.738397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.738475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.738664] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.738757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.738813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.738957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.739036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.739155] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be created. [ 899.814668] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.814668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.814668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.814668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.814668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.828866] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 899.986727] env[61538]: INFO networking_nsxv3.common.synchronization [req-42c408a0-f99b-4fee-9381-25e61e7b9a90 req-073226b4-72d1-4bf8-829c-71fcb005dcc2 tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_members [ 899.986727] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_members [ 899.986727] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4854c6da-988b-40cb-9c61-b312f09d4a28 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.986727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.986727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.986727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.986727] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.986727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.986727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.986727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.986727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.987263] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.225843] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.493116] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.493116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.493116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.493116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.493116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.493116] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.493116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.493116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.493116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.493116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.493116] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 already deleted. [ 900.493116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.728620] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.728885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.728885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.729143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.729257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.729367] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 900.739712] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.739951] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.740053] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.740327] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.740584] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.740740] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.740859] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.741084] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.741237] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.741449] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.741566] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.741679] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.741783] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.741896] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.742021] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.742158] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.780259] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.780432] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 900.780585] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.780862] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.781294] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-af2c9b85-3238-4b4f-b74f-b72d7b575e73 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.781475] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-af2c9b85-3238-4b4f-b74f-b72d7b575e73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.781475] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-af2c9b85-3238-4b4f-b74f-b72d7b575e73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.781797] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-af2c9b85-3238-4b4f-b74f-b72d7b575e73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.782029] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af2c9b85-3238-4b4f-b74f-b72d7b575e73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.784029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.784173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.784245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.784886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.784886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.797713] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 901.239822] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365fd2af-187a-43da-9017-8bc6e06e1910 in Status: SUCCESS [ 901.240412] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365fd2af-187a-43da-9017-8bc6e06e1910 deletion is rescheduled due to dependency. [ 901.240546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365fd2af-187a-43da-9017-8bc6e06e1910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.287664] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.288751] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.289248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.289248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.289655] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.289655] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port af2c9b85-3238-4b4f-b74f-b72d7b575e73 not found, creating... [ 901.289888] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.290075] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.290199] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.290438] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.290706] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.291072] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.291864] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.291864] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.291991] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.292144] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.292326] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: af2c9b85-3238-4b4f-b74f-b72d7b575e73 is going to be created. [ 901.318358] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.318668] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.318806] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.321463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.321463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.321463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-af2c9b85-3238-4b4f-b74f-b72d7b575e73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.844404] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 901.844781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.844841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.845114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.845114] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.348619] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.348619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.518535] env[61538]: INFO networking_nsxv3.common.synchronization [req-7c59f822-a78c-49b8-bc5d-fbd04ba62f90 req-1ef6c81f-4aa4-4ba1-930e-55e817a72d83 tempest-ServerRescueTestJSON-824602145 tempest-ServerRescueTestJSON-824602145-project-member] Enqueued Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 902.522447] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 902.522447] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.522447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.522447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.522447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.522447] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.522447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.522447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.522447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.522447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.522447] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.659639] env[61538]: INFO networking_nsxv3.common.synchronization [req-42c408a0-f99b-4fee-9381-25e61e7b9a90 req-36042744-dce5-40cd-a7e4-913b23bb1df8 service nova] Enqueued Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_rules [ 902.659639] env[61538]: INFO networking_nsxv3.common.synchronization [req-42c408a0-f99b-4fee-9381-25e61e7b9a90 req-36042744-dce5-40cd-a7e4-913b23bb1df8 service nova] Enqueued Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_members [ 902.660023] env[61538]: INFO networking_nsxv3.common.synchronization [req-42c408a0-f99b-4fee-9381-25e61e7b9a90 req-36042744-dce5-40cd-a7e4-913b23bb1df8 service nova] Enqueued Resource ID: af2c9b85-3238-4b4f-b74f-b72d7b575e73 with Priority: HIGHEST for action port [ 902.660692] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_rules [ 902.660914] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_members [ 902.661286] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af2c9b85-3238-4b4f-b74f-b72d7b575e73 with Priority: HIGHEST for action port [ 902.662183] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4854c6da-988b-40cb-9c61-b312f09d4a28 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.662673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.662812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.663100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.663274] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.665271] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4854c6da-988b-40cb-9c61-b312f09d4a28 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.665271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.665271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.665271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.665271] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.665271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.665271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.665271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.665727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.665727] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.666637] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-af2c9b85-3238-4b4f-b74f-b72d7b575e73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.666821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af2c9b85-3238-4b4f-b74f-b72d7b575e73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.666923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af2c9b85-3238-4b4f-b74f-b72d7b575e73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.667126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af2c9b85-3238-4b4f-b74f-b72d7b575e73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.667247] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af2c9b85-3238-4b4f-b74f-b72d7b575e73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.807964] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 902.807964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.807964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.808147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.808552] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.808552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.808552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.808793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.808793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.808873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.808907] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.025415] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.168750] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4854c6da-988b-40cb-9c61-b312f09d4a28 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.168989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.169127] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.169930] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af2c9b85-3238-4b4f-b74f-b72d7b575e73 with status ACTIVE [ 903.170129] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.170247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.170316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.170523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.170613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.170788] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.170902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.170945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.171132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.171211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.171396] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.171491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.171551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.171686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.171820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.171860] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af2c9b85-3238-4b4f-b74f-b72d7b575e73 is going to be updated. [ 903.196975] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.196975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.197233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.197287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.197404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.197575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af2c9b85-3238-4b4f-b74f-b72d7b575e73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.311543] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.311543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.311543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.311543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.311543] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.311543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.311877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.311877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.311877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.312215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.312215] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.312215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.312215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.312474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.312474] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.312599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.312599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.312739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.312822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.312905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.312996] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.529217] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.673595] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.818536] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 794d6c9f-f896-426d-a29e-0a532c759616: rpc.has_security_group_logging(os_id): False [ 903.840805] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.841055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.841055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.841247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.841337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.841557] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.841662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.841724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.841867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.841940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.842143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.842251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.842315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.842441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.842544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.842985] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.842985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.842985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.842985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.844864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.844990] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 903.908287] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.908469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.908518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.908714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.908862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.923407] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 904.031813] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.032424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.032424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.032573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.032573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.032761] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 is going to be updated. [ 904.082731] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.082952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.082952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.083225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.083335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.093849] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: IN_PROGRESS for 2s [ 904.178292] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.178292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.178292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.178292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.178292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.178292] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 is going to be created. [ 904.206539] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.206539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.206539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.206539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.206539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.227449] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 in Status: UNINITIALIZED for 2s [ 905.941017] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 905.941438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.106660] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: SUCCESS [ 906.106974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.240295] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 in Status: SUCCESS [ 906.240295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.240295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.240295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.240295] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.240295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.240295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.240295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.240295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.240295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.240295] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.745714] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.248862] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4854c6da-988b-40cb-9c61-b312f09d4a28: rpc.has_security_group_logging(os_id): False [ 907.266158] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.266359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.266405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.266612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.266703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.267055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.267277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.267277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.267373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.267433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.267543] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 is going to be created. [ 907.335510] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.335510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.345756] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 in Status: IN_PROGRESS for 2s [ 907.662029] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 907.662217] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 909.285106] env[61538]: INFO networking_nsxv3.common.synchronization [req-d1eeb806-a7ca-4710-84f1-d1a9fc7a2c84 req-6eff1704-dc1b-437d-ae3e-218424af862b tempest-MultipleCreateTestJSON-1583574743 tempest-MultipleCreateTestJSON-1583574743-project-member] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 909.285702] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 909.288694] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.288868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.288917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.289167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.289587] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.289587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.289587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.289859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.289859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.289859] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.360093] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 in Status: SUCCESS [ 909.360439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.716505] env[61538]: INFO networking_nsxv3.common.synchronization [req-0ac9c65e-d4d8-4d96-bad4-95928bde23c3 req-b282959d-749d-4e86-bf96-91ff51db0025 tempest-MultipleCreateTestJSON-1583574743 tempest-MultipleCreateTestJSON-1583574743-project-member] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 909.717163] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGHEST for action security_group_members [ 909.717610] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.717610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.793156] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.836829] env[61538]: INFO networking_nsxv3.common.synchronization [req-da4b5876-d1c1-4983-a950-f539aff9576e req-6207180d-642d-4f65-baf7-f390cd11c527 tempest-ListImageFiltersTestJSON-574044180 tempest-ListImageFiltersTestJSON-574044180-project-member] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 909.836829] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGHEST for action security_group_members [ 909.836829] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.837607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.837607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.837607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.841027] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.841027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.841027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.841027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.841027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.841027] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.296262] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.342943] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.343131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.343200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.343409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.365581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.365749] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.366385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.366549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.366827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.367200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.367398] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 is going to be updated. [ 910.396911] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.396911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.396911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.397081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.397114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.406594] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: IN_PROGRESS for 2s [ 910.427361] env[61538]: INFO networking_nsxv3.common.synchronization [req-ce36afc5-5ead-46e4-8e83-526d9448dee5 req-4c1224fd-a13c-4465-a28c-8edfa99a7190 tempest-VolumesAdminNegativeTest-2067435148 tempest-VolumesAdminNegativeTest-2067435148-project-member] Enqueued Resource ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 with Priority: HIGHEST for action security_group_members [ 910.427901] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 with Priority: HIGHEST for action security_group_members [ 910.428431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aac9359-4a9b-4456-9463-ba08a19c23d6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.428651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.428718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.429412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.429635] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.430064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.430064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.430172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.430289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.430427] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1aac9359-4a9b-4456-9463-ba08a19c23d6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.800991] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.801174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.801225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.801826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.801826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.801826] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 910.833036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.833218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.833259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.833478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.833604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.844224] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 910.899094] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.899312] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.899439] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.899717] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.900123] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.900220] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.900316] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.900531] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.901339] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.901762] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.901897] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.902034] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.902146] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.902341] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.902414] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.902508] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.925374] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.925542] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.925685] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.925878] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.926227] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-1e891b2e-5640-4992-b111-00dfc1ad763a taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.926409] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-1e891b2e-5640-4992-b111-00dfc1ad763a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.926534] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-1e891b2e-5640-4992-b111-00dfc1ad763a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.926873] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-1e891b2e-5640-4992-b111-00dfc1ad763a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.927037] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e891b2e-5640-4992-b111-00dfc1ad763a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.933190] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.933379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.933423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.933600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.933971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.933971] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.933971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.934176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.934176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.934246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.934339] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 already deleted. [ 910.934419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.406869] env[61538]: INFO networking_nsxv3.common.synchronization [req-c70d1024-3f30-4291-8fbc-54a0773c4e8c req-016a7a3e-0fd6-4350-88b9-a4ca1e047ce1 tempest-ServersV294TestFqdnHostnames-598528889 tempest-ServersV294TestFqdnHostnames-598528889-project-member] Enqueued Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_members [ 911.407920] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded91e44-4a5f-4d2c-a527-86674f66c321 with Priority: HIGHEST for action security_group_members [ 911.408409] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded91e44-4a5f-4d2c-a527-86674f66c321 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.408755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.408935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.409247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.409518] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.409746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.411325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.411325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.411325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.411325] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ded91e44-4a5f-4d2c-a527-86674f66c321',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.429559] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.430177] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.430794] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.431215] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.431512] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.431785] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 1e891b2e-5640-4992-b111-00dfc1ad763a not found, creating... [ 911.432182] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.433038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.433038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.433038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.433038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.433871] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.434390] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.434390] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.436832] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.436832] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.436832] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 1e891b2e-5640-4992-b111-00dfc1ad763a is going to be created. [ 911.460124] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.460124] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.460124] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.460124] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.460124] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.460124] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-1e891b2e-5640-4992-b111-00dfc1ad763a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.912287] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.912461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.912537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.912785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.938242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.938507] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.938622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.938691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.938899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.938981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.939087] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ded91e44-4a5f-4d2c-a527-86674f66c321 is going to be updated. [ 911.967707] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.967944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.968088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.968393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.968602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.984327] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ded91e44-4a5f-4d2c-a527-86674f66c321 in Status: IN_PROGRESS for 2s [ 912.208128] env[61538]: INFO networking_nsxv3.common.synchronization [req-ce36afc5-5ead-46e4-8e83-526d9448dee5 req-e684203e-6e0a-45ba-9a18-77efe0140e28 service nova] Enqueued Resource ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 with Priority: HIGHEST for action security_group_rules [ 912.208320] env[61538]: INFO networking_nsxv3.common.synchronization [req-ce36afc5-5ead-46e4-8e83-526d9448dee5 req-e684203e-6e0a-45ba-9a18-77efe0140e28 service nova] Enqueued Resource ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 with Priority: HIGHEST for action security_group_members [ 912.208457] env[61538]: INFO networking_nsxv3.common.synchronization [req-ce36afc5-5ead-46e4-8e83-526d9448dee5 req-e684203e-6e0a-45ba-9a18-77efe0140e28 service nova] Enqueued Resource ID: 1e891b2e-5640-4992-b111-00dfc1ad763a with Priority: HIGHEST for action port [ 912.210589] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 with Priority: HIGHEST for action security_group_rules [ 912.210712] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 with Priority: HIGHEST for action security_group_members [ 912.210816] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e891b2e-5640-4992-b111-00dfc1ad763a with Priority: HIGHEST for action port [ 912.211170] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1aac9359-4a9b-4456-9463-ba08a19c23d6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.211293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.211368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.214066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.214173] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1aac9359-4a9b-4456-9463-ba08a19c23d6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.215212] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aac9359-4a9b-4456-9463-ba08a19c23d6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.215334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.215409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.215605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.215758] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.215854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.215912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.216101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.216186] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.216441] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1aac9359-4a9b-4456-9463-ba08a19c23d6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.218278] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e891b2e-5640-4992-b111-00dfc1ad763a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.218413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e891b2e-5640-4992-b111-00dfc1ad763a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.218455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e891b2e-5640-4992-b111-00dfc1ad763a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.218736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e891b2e-5640-4992-b111-00dfc1ad763a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.218736] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e891b2e-5640-4992-b111-00dfc1ad763a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.417019] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 in Status: SUCCESS [ 912.417019] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 deletion is rescheduled due to dependency. [ 912.417019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.721913] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1aac9359-4a9b-4456-9463-ba08a19c23d6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.722816] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aac9359-4a9b-4456-9463-ba08a19c23d6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.722949] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.723571] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e891b2e-5640-4992-b111-00dfc1ad763a with status ACTIVE [ 912.723571] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.723571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.723571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.723846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.723846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.723924] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.723989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.724721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.724962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.725697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.725697] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.725697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.725697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.725697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.725697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.726020] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e891b2e-5640-4992-b111-00dfc1ad763a is going to be updated. [ 912.749010] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.749204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.749204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.749409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.749520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.750263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e891b2e-5640-4992-b111-00dfc1ad763a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.855556] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 912.855801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.856030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.856267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.856473] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.856597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.856661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.856811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.856927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.857019] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.228628] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1aac9359-4a9b-4456-9463-ba08a19c23d6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.361512] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.361710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.361768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.361966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.362087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.362304] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.362406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.362463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.362614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.362689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.362776] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be updated. [ 913.396824] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.397126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.397126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.399151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.399151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.406346] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: IN_PROGRESS for 2s [ 913.733113] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.733456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.733656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.733973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.734182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.734468] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 is going to be created. [ 913.760121] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.760309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.760309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.760613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.760779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.772024] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 in Status: UNINITIALIZED for 2s [ 913.993535] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ded91e44-4a5f-4d2c-a527-86674f66c321 in Status: SUCCESS [ 913.993731] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ded91e44-4a5f-4d2c-a527-86674f66c321 deletion is rescheduled due to dependency. [ 913.993829] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded91e44-4a5f-4d2c-a527-86674f66c321" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.417937] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 794d6c9f-f896-426d-a29e-0a532c759616 in Status: SUCCESS [ 915.417937] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 deletion is rescheduled due to dependency. [ 915.417937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.783035] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 in Status: SUCCESS [ 915.784273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.784273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.784273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.784273] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.784273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.784273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.784613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.784613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.784613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.784613] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1aac9359-4a9b-4456-9463-ba08a19c23d6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.287846] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aac9359-4a9b-4456-9463-ba08a19c23d6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.288105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.288169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.288517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.288761] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.288888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.288950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.289181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.289329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.289494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.289722] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aac9359-4a9b-4456-9463-ba08a19c23d6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.289896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.290150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.290268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.290664] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.290805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.290929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.291153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.291313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.291470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.291572] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1aac9359-4a9b-4456-9463-ba08a19c23d6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.378450] env[61538]: INFO networking_nsxv3.common.synchronization [req-38490d9b-e56d-4717-a9b5-005d819a6118 req-287c9b3d-93c6-4b64-b3cf-b62a24dab4ad tempest-ListServerFiltersTestJSON-816069453 tempest-ListServerFiltersTestJSON-816069453-project-member] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 916.379225] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 916.379574] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.379722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.379794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.380039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.380235] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.380358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.380447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.380637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.380766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.380877] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.794096] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1aac9359-4a9b-4456-9463-ba08a19c23d6: rpc.has_security_group_logging(os_id): False [ 916.834088] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.834088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.834088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.834088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.834088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.834088] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.834721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.834721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.834721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.834721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.834721] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.835012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.835012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.835012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.835193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.835248] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.835333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.835390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.835525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.835587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.835680] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 is going to be created. [ 916.883873] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.922720] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.922958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.922958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.923138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.923329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.937496] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 in Status: IN_PROGRESS for 2s [ 917.387124] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.889659] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.891605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.891605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.891605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.891605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.891605] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be updated. [ 917.922137] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.922137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.922137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.922137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.922137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.932490] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 918.951514] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 in Status: SUCCESS [ 918.951514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.942973] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 919.943219] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.380355] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 921.380678] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 925.900068] env[61538]: INFO networking_nsxv3.common.synchronization [req-6c1e40c7-e060-4b73-8ad2-15b2123548c4 req-7c1ae8a6-5a6c-4aae-898f-06a93776246b tempest-VolumesAdminNegativeTest-2067435148 tempest-VolumesAdminNegativeTest-2067435148-project-member] Enqueued Resource ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 with Priority: HIGHEST for action security_group_members [ 925.900704] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 with Priority: HIGHEST for action security_group_members [ 925.901083] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aac9359-4a9b-4456-9463-ba08a19c23d6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.901251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.901361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.902516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.902689] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.902794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.902860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.903040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.903132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.903227] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1aac9359-4a9b-4456-9463-ba08a19c23d6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.408455] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.408455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.408455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.408455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.408455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.408455] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.408455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.408455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.408455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.408455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.408455] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 is going to be updated. [ 926.441320] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.441617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.441710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.441992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.442337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.452417] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 in Status: IN_PROGRESS for 2s [ 926.966106] env[61538]: INFO networking_nsxv3.common.synchronization [req-5ac858b1-a5c9-41e4-a49b-5ee50555e312 req-69fb1ecb-aa13-4393-b817-19a916944001 tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_members [ 926.966106] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_members [ 926.966106] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.966106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.966106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.966106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.966106] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.966106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.967030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.967322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.968628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.968857] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.364408] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.364408] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.364408] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.364620] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.368242] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.368528] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.368590] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.368857] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.369032] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.371852] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.371852] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.371852] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.371852] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.372021] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.372176] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.372369] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.397576] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.397757] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.397901] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.398112] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.398598] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-bf240544-0938-4b0c-9469-4d66bd37ee14 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.398671] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-bf240544-0938-4b0c-9469-4d66bd37ee14" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.398746] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-bf240544-0938-4b0c-9469-4d66bd37ee14" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.399095] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-bf240544-0938-4b0c-9469-4d66bd37ee14" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.399249] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf240544-0938-4b0c-9469-4d66bd37ee14',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.471737] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.471905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.471982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.472225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.472319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.472520] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.472661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.472706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.473357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.473357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.473357] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e already deleted. [ 927.473357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.904037] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.904367] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.904543] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.904875] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.905029] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.905288] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port bf240544-0938-4b0c-9469-4d66bd37ee14 not found, creating... [ 927.905490] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.905662] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.905788] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.906045] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.906199] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.906494] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.906661] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.909154] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.909154] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.909154] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.909154] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: bf240544-0938-4b0c-9469-4d66bd37ee14 is going to be created. [ 927.931708] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.931708] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.932465] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.932465] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.932465] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.932593] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-bf240544-0938-4b0c-9469-4d66bd37ee14" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.464860] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 in Status: SUCCESS [ 928.465214] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1aac9359-4a9b-4456-9463-ba08a19c23d6 deletion is rescheduled due to dependency. [ 928.465254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aac9359-4a9b-4456-9463-ba08a19c23d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.695538] env[61538]: INFO networking_nsxv3.common.synchronization [req-5ac858b1-a5c9-41e4-a49b-5ee50555e312 req-4ccbb075-d645-4c1a-814c-aa373e002036 service nova] Enqueued Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_rules [ 928.695764] env[61538]: INFO networking_nsxv3.common.synchronization [req-5ac858b1-a5c9-41e4-a49b-5ee50555e312 req-4ccbb075-d645-4c1a-814c-aa373e002036 service nova] Enqueued Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_members [ 928.695995] env[61538]: INFO networking_nsxv3.common.synchronization [req-5ac858b1-a5c9-41e4-a49b-5ee50555e312 req-4ccbb075-d645-4c1a-814c-aa373e002036 service nova] Enqueued Resource ID: bf240544-0938-4b0c-9469-4d66bd37ee14 with Priority: HIGHEST for action port [ 928.697396] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_rules [ 928.697569] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_members [ 928.697682] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf240544-0938-4b0c-9469-4d66bd37ee14 with Priority: HIGHEST for action port [ 928.698484] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.698627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.698691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.698908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.699034] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.701802] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.702066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.702202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.702362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.702528] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.702627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.702689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.702819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.705022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.705022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.705022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf240544-0938-4b0c-9469-4d66bd37ee14 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.705022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf240544-0938-4b0c-9469-4d66bd37ee14" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.705022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf240544-0938-4b0c-9469-4d66bd37ee14" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.705022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf240544-0938-4b0c-9469-4d66bd37ee14" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.705022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf240544-0938-4b0c-9469-4d66bd37ee14',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.202551] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.202682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.208116] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.208648] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf240544-0938-4b0c-9469-4d66bd37ee14 with status ACTIVE [ 929.208848] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.209385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.209502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.209790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.209905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.210189] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.210393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.210463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.210621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.210695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.211181] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.211314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.211382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.211538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.211620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.211708] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf240544-0938-4b0c-9469-4d66bd37ee14 is going to be updated. [ 929.249867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.250028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.250106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.250331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.250463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.250619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf240544-0938-4b0c-9469-4d66bd37ee14" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.714076] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.216457] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.216457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.216600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.217754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.217754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.217754] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e is going to be created. [ 930.245155] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.245266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.245339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.245553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.245731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.259659] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e in Status: UNINITIALIZED for 2s [ 932.272208] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e in Status: SUCCESS [ 932.272208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.272208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.272208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.272208] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.272208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.272208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.272208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.272208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.272208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.272208] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.393314] env[61538]: INFO networking_nsxv3.common.synchronization [req-110f9e11-5849-4352-82c5-340e50f2d8c6 req-e11c6faf-e402-4ed4-9241-41d6cbbf6716 tempest-AttachVolumeTestJSON-1443084926 tempest-AttachVolumeTestJSON-1443084926-project-member] Enqueued Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_members [ 932.393779] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_members [ 932.393958] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b226ae7-1968-4740-8cac-2825cb2bf00f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.394133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.394200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.394488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.394655] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.394977] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.394977] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.395099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.395099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.395203] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.777472] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.802088] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.802088] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-279" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.802222] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-279" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.802649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-279" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.803044] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.803319] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.803557] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.803796] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.804083] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.804309] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.804616] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.804735] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.804765] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.805039] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.805094] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.805255] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.833896] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.833896] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 932.833896] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.833896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-279" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.833896] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-989b3fc6-0843-488f-9af2-39bb487eb78a taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.833896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-989b3fc6-0843-488f-9af2-39bb487eb78a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.833896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-989b3fc6-0843-488f-9af2-39bb487eb78a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.833896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-989b3fc6-0843-488f-9af2-39bb487eb78a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.833896] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('989b3fc6-0843-488f-9af2-39bb487eb78a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.898237] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.898237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.898237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.898473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.898473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.898672] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.898768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.898827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.898973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.899056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.899137] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f already deleted. [ 932.899216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.281960] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 183bb0f5-0c4a-4a88-8d23-eca114a3a62e: rpc.has_security_group_logging(os_id): False [ 933.302667] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.302667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.302667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.302667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.303197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.304881] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.304881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.304881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.304881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.304881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.304881] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e is going to be created. [ 933.341023] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.341023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.341023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.341023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.341023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.341023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 989b3fc6-0843-488f-9af2-39bb487eb78a not found, creating... [ 933.341023] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.341023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.341023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.341023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.341023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.341771] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.342151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.343157] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.343539] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.344197] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.344197] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 989b3fc6-0843-488f-9af2-39bb487eb78a is going to be created. [ 933.370168] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.370168] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.370168] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.370168] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.370168] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.370168] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-989b3fc6-0843-488f-9af2-39bb487eb78a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.382993] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.382993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.382993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.382993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.382993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.400871] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e in Status: IN_PROGRESS for 2s [ 933.636391] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1a0b58e2-b460-4af8-8bfd-1accb5fb3086 None None] Enqueued Resource ID: cf6a54b1-8cd8-417c-9350-a7fa3d987d63 with Priority: HIGHEST for action port [ 933.637248] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf6a54b1-8cd8-417c-9350-a7fa3d987d63 with Priority: HIGHEST for action port [ 933.637774] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf6a54b1-8cd8-417c-9350-a7fa3d987d63 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.637954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf6a54b1-8cd8-417c-9350-a7fa3d987d63" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.638409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf6a54b1-8cd8-417c-9350-a7fa3d987d63" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.638409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf6a54b1-8cd8-417c-9350-a7fa3d987d63" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.638566] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf6a54b1-8cd8-417c-9350-a7fa3d987d63',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.141055] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf6a54b1-8cd8-417c-9350-a7fa3d987d63 [ 934.141319] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.141459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.141529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.141769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.141826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.141924] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf6a54b1-8cd8-417c-9350-a7fa3d987d63 already deleted. [ 934.142013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf6a54b1-8cd8-417c-9350-a7fa3d987d63" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.237288] env[61538]: INFO networking_nsxv3.common.synchronization [req-110f9e11-5849-4352-82c5-340e50f2d8c6 req-1bed125c-b5ec-442a-961c-1c5244f06c88 service nova] Enqueued Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_rules [ 934.237536] env[61538]: INFO networking_nsxv3.common.synchronization [req-110f9e11-5849-4352-82c5-340e50f2d8c6 req-1bed125c-b5ec-442a-961c-1c5244f06c88 service nova] Enqueued Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_members [ 934.237755] env[61538]: INFO networking_nsxv3.common.synchronization [req-110f9e11-5849-4352-82c5-340e50f2d8c6 req-1bed125c-b5ec-442a-961c-1c5244f06c88 service nova] Enqueued Resource ID: 989b3fc6-0843-488f-9af2-39bb487eb78a with Priority: HIGHEST for action port [ 934.238013] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_rules [ 934.239130] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_members [ 934.239130] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 989b3fc6-0843-488f-9af2-39bb487eb78a with Priority: HIGHEST for action port [ 934.239130] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b226ae7-1968-4740-8cac-2825cb2bf00f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.239130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.239130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.239561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.239561] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.240252] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b226ae7-1968-4740-8cac-2825cb2bf00f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.240374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.240441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.240664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.240845] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.240939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.241013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.241163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.241244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.241327] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.246120] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-989b3fc6-0843-488f-9af2-39bb487eb78a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.246263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-989b3fc6-0843-488f-9af2-39bb487eb78a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.246346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-989b3fc6-0843-488f-9af2-39bb487eb78a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.246513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-989b3fc6-0843-488f-9af2-39bb487eb78a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.246589] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('989b3fc6-0843-488f-9af2-39bb487eb78a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.749556] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b226ae7-1968-4740-8cac-2825cb2bf00f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.749556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.749556] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.749977] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 989b3fc6-0843-488f-9af2-39bb487eb78a with status ACTIVE [ 934.749977] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.750099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.750139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.750469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.750469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.750606] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.751222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.751222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.751222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.751222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.751222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.751222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.751413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.751413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.751466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.751542] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 989b3fc6-0843-488f-9af2-39bb487eb78a is going to be updated. [ 934.771709] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.771838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.771916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.772135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.772277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.772435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-989b3fc6-0843-488f-9af2-39bb487eb78a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.047340] env[61538]: INFO networking_nsxv3.common.synchronization [req-9f2cae1f-b6e8-4d01-acb0-c71f46943bce req-cd4c5a6f-13d6-4a5e-9e10-0a44e3c7737b tempest-ServersNegativeTestJSON-1742660343 tempest-ServersNegativeTestJSON-1742660343-project-member] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 935.047967] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 935.048276] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.049025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.049025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.049025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.049025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.049025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.050523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.050523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.050523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.050523] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.253541] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.415563] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e in Status: SUCCESS [ 935.416836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.556515] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.556515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.556515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.556515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.556515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.556515] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.556515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.556515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.556515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.556515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.556515] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d already deleted. [ 935.556515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.661086] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-45 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.661086] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.661086] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.665027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.665027] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.665027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.665027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.665027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.665027] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.665027] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.665027] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.665027] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.665027] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.665027] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.665027] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.666401] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.687939] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.688155] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 935.688370] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.688527] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.688857] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-2147b830-281d-4a24-90d1-22eccefc4c5c taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.689456] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.689456] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.689599] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.689653] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2147b830-281d-4a24-90d1-22eccefc4c5c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.758036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.758036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.758036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.758574] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.758574] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.758574] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f is going to be created. [ 935.795070] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.795070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.795070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.795070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.795070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.805339] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f in Status: UNINITIALIZED for 2s [ 936.195935] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.196270] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.196409] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.196707] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.196867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.197090] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 2147b830-281d-4a24-90d1-22eccefc4c5c not found, creating... [ 936.197390] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.197559] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.197684] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.201030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.201030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.201030] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.201030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.201030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.201030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.201030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.201030] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 2147b830-281d-4a24-90d1-22eccefc4c5c is going to be created. [ 936.216776] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c6839b6a-ed97-4d98-804f-7f0b4948b9ae None None] Enqueued Resource ID: 20d69d5b-b23b-48d6-8415-c7c707797760 with Priority: HIGHEST for action port [ 936.220142] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20d69d5b-b23b-48d6-8415-c7c707797760 with Priority: HIGHEST for action port [ 936.220142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-20d69d5b-b23b-48d6-8415-c7c707797760 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.220142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20d69d5b-b23b-48d6-8415-c7c707797760" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.220142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20d69d5b-b23b-48d6-8415-c7c707797760" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.220142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20d69d5b-b23b-48d6-8415-c7c707797760" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.220142] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20d69d5b-b23b-48d6-8415-c7c707797760',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.221294] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.221666] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.221768] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.222142] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.222486] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.222838] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.725302] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20d69d5b-b23b-48d6-8415-c7c707797760 [ 936.725932] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.726197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.726197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.726423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.726555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.726697] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20d69d5b-b23b-48d6-8415-c7c707797760 already deleted. [ 936.726814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20d69d5b-b23b-48d6-8415-c7c707797760" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.199541] env[61538]: INFO networking_nsxv3.common.synchronization [req-9f2cae1f-b6e8-4d01-acb0-c71f46943bce req-de0feffd-8a02-40e2-895d-756839e71cd8 service nova] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_rules [ 937.199887] env[61538]: INFO networking_nsxv3.common.synchronization [req-9f2cae1f-b6e8-4d01-acb0-c71f46943bce req-de0feffd-8a02-40e2-895d-756839e71cd8 service nova] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 937.199932] env[61538]: INFO networking_nsxv3.common.synchronization [req-9f2cae1f-b6e8-4d01-acb0-c71f46943bce req-de0feffd-8a02-40e2-895d-756839e71cd8 service nova] Enqueued Resource ID: 2147b830-281d-4a24-90d1-22eccefc4c5c with Priority: HIGHEST for action port [ 937.200602] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_rules [ 937.200804] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 937.200974] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2147b830-281d-4a24-90d1-22eccefc4c5c with Priority: HIGHEST for action port [ 937.201389] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.201555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.201604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.201843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.201927] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.203179] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.203304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.203358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.203522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.203685] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.203780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.203844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.204061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.204174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.204267] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.205373] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2147b830-281d-4a24-90d1-22eccefc4c5c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.205510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.205561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.205710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.205775] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2147b830-281d-4a24-90d1-22eccefc4c5c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.708101] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.708265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.708511] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.709990] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2147b830-281d-4a24-90d1-22eccefc4c5c with status ACTIVE [ 937.710222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.710340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.710408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.710633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.710762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.710980] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.711111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.711178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.711358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.711475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.711682] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.711791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.711853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.712043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.712149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.712255] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2147b830-281d-4a24-90d1-22eccefc4c5c is going to be updated. [ 937.738794] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.738927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.739010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.739370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.739556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.739729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.816116] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f in Status: SUCCESS [ 937.816338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.816499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.816723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.816919] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.817107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.817192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.817342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.817469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.817557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.817588] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.212098] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.320867] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.715071] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.715318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.715457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.715695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.715786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.715885] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be created. [ 938.745208] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.745334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.745457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.745641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.745998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.756219] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: UNINITIALIZED for 2s [ 938.823759] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b226ae7-1968-4740-8cac-2825cb2bf00f: rpc.has_security_group_logging(os_id): False [ 938.846434] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.846675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.846675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.846857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.846960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.847266] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.847368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.847434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.847594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.847675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.847762] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f is going to be created. [ 938.916949] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.917217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.917262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.917464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.917648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.940633] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f in Status: IN_PROGRESS for 2s [ 940.766651] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 940.766991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.766991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.767323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.767474] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.767593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.767651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.767804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.767885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.767970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.768103] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.953368] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f in Status: SUCCESS [ 940.953631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.275041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.275041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.275041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.275041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.275041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.275041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.275444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.275444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.275444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.275638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.275920] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.276058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.276058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.276208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.276369] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.276469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.276525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.276676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.276754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.276842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.276948] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.779707] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bc3281e-af92-4997-a592-c0e030784b0d: rpc.has_security_group_logging(os_id): False [ 941.827049] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.827049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.827049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.827049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.827049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.827421] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.827495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.827495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.827712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.827816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.828093] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.828247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.828329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.828499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.828606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.828861] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.828969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.829050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.829237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.829330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.829446] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be created. [ 941.894146] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.894353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.894467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.894735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.894971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.908961] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: IN_PROGRESS for 2s [ 942.202042] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 942.202209] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 943.925371] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 943.925706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.880503] env[61538]: INFO networking_nsxv3.common.synchronization [req-62d9fc90-43c7-4452-bd8e-42e59223efa0 req-46486cfb-4878-4fb7-a213-aa69833b05a4 tempest-ServerRescueNegativeTestJSON-252212181 tempest-ServerRescueNegativeTestJSON-252212181-project-member] Enqueued Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_members [ 944.881188] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_members [ 944.881432] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-f48c1e26-03f2-45d2-b576-a2404afc7d50 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.881587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.881629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.881868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.882024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.882117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.882191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.882347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.882427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.882515] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.384433] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.384963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.384963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.385147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.385358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.385589] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.385704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.385764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.386015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.386182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.386382] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 already deleted. [ 945.386566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.765038] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.765038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.765038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.765038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.765038] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.765038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.765038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.765038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.765038] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.765038] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.765038] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.765038] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.765038] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.765718] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.765718] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.765718] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.765718] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.765718] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.765718] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.765718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-540" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.765718] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.765718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.765718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.765718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.765718] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.263928] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.263928] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.263928] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.263928] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.263928] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.263928] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f not found, creating... [ 946.263928] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.263928] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.263928] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.263928] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.263928] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.264592] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.264592] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.264592] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.264592] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.264592] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.265398] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f is going to be created. [ 946.287810] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.287810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.287810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.287810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.287810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.287810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.133311] env[61538]: INFO networking_nsxv3.common.synchronization [req-8e4a8fe4-9c55-47c4-9372-c4007b87d80a req-46db86af-284d-4777-a5b6-4b32abcc6f24 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 947.133843] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 947.134239] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.134367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.134436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.134623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.134774] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.134874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.134932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.135135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.135224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.135551] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.368382] env[61538]: INFO networking_nsxv3.common.synchronization [req-62d9fc90-43c7-4452-bd8e-42e59223efa0 req-f5bd838f-2266-4364-b76a-26018defddd0 service nova] Enqueued Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_rules [ 947.368382] env[61538]: INFO networking_nsxv3.common.synchronization [req-62d9fc90-43c7-4452-bd8e-42e59223efa0 req-f5bd838f-2266-4364-b76a-26018defddd0 service nova] Enqueued Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_members [ 947.368382] env[61538]: INFO networking_nsxv3.common.synchronization [req-62d9fc90-43c7-4452-bd8e-42e59223efa0 req-f5bd838f-2266-4364-b76a-26018defddd0 service nova] Enqueued Resource ID: 5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f with Priority: HIGHEST for action port [ 947.368617] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_rules [ 947.368617] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_members [ 947.370973] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f with Priority: HIGHEST for action port [ 947.371284] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f48c1e26-03f2-45d2-b576-a2404afc7d50 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.371408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.372395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.372395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.372395] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.374546] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-f48c1e26-03f2-45d2-b576-a2404afc7d50 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.374658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.374722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.374900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.375067] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.375159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.375218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.375355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.377053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.377053] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.377053] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.377471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.377471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.377471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.377471] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.468026] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-942 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.468157] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-942" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.468384] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-942" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.468715] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-942" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.469063] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.469313] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.469504] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.470063] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.470063] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.470186] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.470355] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.470525] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.470678] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.470849] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.471007] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.471218] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.498187] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.498464] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 947.498707] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.498965] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-942" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.499342] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.499651] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.499801] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.500144] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.500294] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ea1dae1-c4a7-423c-9d65-dbc15e4848b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.638469] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.875741] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-f48c1e26-03f2-45d2-b576-a2404afc7d50 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.875988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.879344] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.880328] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f with status ACTIVE [ 947.880533] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.880655] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.880721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.880935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.881089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.881469] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.881469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.881469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.881596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.881695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.881879] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.881969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.882060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.882206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.882330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.882360] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f is going to be updated. [ 947.907826] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.908094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.908248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.908677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.908935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.910108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fdf9f41-2fb1-4e55-9ee1-90954aee9f9f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.002939] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.003298] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.003477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.003795] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.003961] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.004143] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 not found, creating... [ 948.004441] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.004615] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.004741] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.004983] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.005192] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.005498] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.005665] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.005790] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.006020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.006169] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.006318] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 is going to be created. [ 948.052055] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.052405] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.052617] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.053145] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.053468] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.053717] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.141691] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.384194] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.644534] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.644769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.644816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.645088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.645189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.645280] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 948.675522] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.675667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.675720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.675930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.676089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.684939] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 948.732041] env[61538]: INFO networking_nsxv3.common.synchronization [req-8e4a8fe4-9c55-47c4-9372-c4007b87d80a req-d39f5b59-0fa5-482e-bdf9-84e64e246dd6 service nova] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 948.732041] env[61538]: INFO networking_nsxv3.common.synchronization [req-8e4a8fe4-9c55-47c4-9372-c4007b87d80a req-d39f5b59-0fa5-482e-bdf9-84e64e246dd6 service nova] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 948.732041] env[61538]: INFO networking_nsxv3.common.synchronization [req-8e4a8fe4-9c55-47c4-9372-c4007b87d80a req-d39f5b59-0fa5-482e-bdf9-84e64e246dd6 service nova] Enqueued Resource ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 with Priority: HIGHEST for action port [ 948.732041] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 948.732041] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 948.732041] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 with Priority: HIGHEST for action port [ 948.732041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.732041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.732041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.732041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.732041] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.732041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.732716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.732716] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.732716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.732716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.732716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.732716] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ea1dae1-c4a7-423c-9d65-dbc15e4848b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.888050] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.888050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.888050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.888050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.888050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.888050] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 is going to be created. [ 948.912250] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.912440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.912440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.912646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.912800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.922245] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 in Status: UNINITIALIZED for 2s [ 949.237243] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.237243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.237243] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 with status ACTIVE [ 949.237243] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.237607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.237607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.237607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.237687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.237780] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.237865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.237921] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.238088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.238171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.238377] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.238467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.238522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.238656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.238724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.238801] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 is going to be updated. [ 949.259958] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.260131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.260168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.260363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.260485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.260634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.819625] env[61538]: INFO networking_nsxv3.common.synchronization [req-2ae055f3-9abc-47ec-bcb9-f788e5e2f8a9 req-c9eecfa4-8289-4910-b85f-fe3bf6c0e795 tempest-AttachVolumeShelveTestJSON-1204522908 tempest-AttachVolumeShelveTestJSON-1204522908-project-member] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_members [ 949.819625] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_members [ 949.819625] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.819625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.819625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.820907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.821866] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.822430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.822698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.822981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.823202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.823439] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.149839] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.150073] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.150208] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.150567] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.150845] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.151036] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.151234] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.151466] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.151621] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.151829] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.151946] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.152722] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.152722] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.152722] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.152722] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.152722] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.174066] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.174279] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 950.174449] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.174692] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.175088] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-7e7e6bd8-fac2-4516-af29-a249216acca6 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.176645] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.176645] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.176645] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.176645] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e7e6bd8-fac2-4516-af29-a249216acca6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.326501] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.326773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.326773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.327068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.327269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.327528] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.327722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.327826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.328030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.328149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.328271] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ba62abf-b989-4453-9509-66329821ead3 already deleted. [ 950.328475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.679214] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.679517] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.679657] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.679947] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.680122] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.680315] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 7e7e6bd8-fac2-4516-af29-a249216acca6 not found, creating... [ 950.680605] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.680767] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.680890] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.681127] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.681294] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.681616] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.681782] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.682648] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.686806] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.686806] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.686806] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 7e7e6bd8-fac2-4516-af29-a249216acca6 is going to be created. [ 950.697353] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 950.697353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.697353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.697713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.697713] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.697855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.697855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.698287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.698287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.698287] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.709788] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.710040] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.710193] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.710650] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.710932] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.711218] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.934782] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 in Status: SUCCESS [ 950.935307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.935603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.935913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.936295] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.936560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.936715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.936956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.937204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.937403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.937591] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.200718] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.409381] env[61538]: INFO networking_nsxv3.common.synchronization [req-2ae055f3-9abc-47ec-bcb9-f788e5e2f8a9 req-6502634d-f6ee-4a28-a3fb-0e0011d59b00 service nova] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_rules [ 951.409381] env[61538]: INFO networking_nsxv3.common.synchronization [req-2ae055f3-9abc-47ec-bcb9-f788e5e2f8a9 req-6502634d-f6ee-4a28-a3fb-0e0011d59b00 service nova] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_members [ 951.409381] env[61538]: INFO networking_nsxv3.common.synchronization [req-2ae055f3-9abc-47ec-bcb9-f788e5e2f8a9 req-6502634d-f6ee-4a28-a3fb-0e0011d59b00 service nova] Enqueued Resource ID: 7e7e6bd8-fac2-4516-af29-a249216acca6 with Priority: HIGHEST for action port [ 951.409381] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_rules [ 951.409381] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_members [ 951.409381] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e7e6bd8-fac2-4516-af29-a249216acca6 with Priority: HIGHEST for action port [ 951.410066] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.410319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.410459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.410777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.410967] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.412268] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.412535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.412688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.413046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.413288] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.413501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.413639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.413867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.414049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.414226] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.415565] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e7e6bd8-fac2-4516-af29-a249216acca6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.415565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.415808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.415808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.415808] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e7e6bd8-fac2-4516-af29-a249216acca6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.440537] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.703726] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.917644] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.917833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.918040] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.919108] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e7e6bd8-fac2-4516-af29-a249216acca6 with status ACTIVE [ 951.919372] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.919566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.919566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.919790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.919890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.920076] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.920194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.920433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.920476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.920612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.920744] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.920852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.920921] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.921061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.921143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.921304] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e7e6bd8-fac2-4516-af29-a249216acca6 is going to be updated. [ 951.943020] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f48c1e26-03f2-45d2-b576-a2404afc7d50: rpc.has_security_group_logging(os_id): False [ 951.947886] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.948124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.948124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.948408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.948567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.948757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.965377] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.965659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.965659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.965960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.966080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.966389] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.966707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.966707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.966862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.966960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.967100] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 is going to be created. [ 952.100743] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.101060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.101060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.101412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.101513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.118706] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 in Status: IN_PROGRESS for 2s [ 952.205345] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.205725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.205725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.205862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.205862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.206038] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 952.259910] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.260144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.260192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.264324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.264578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.280709] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 952.423429] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.857807] env[61538]: INFO networking_nsxv3.common.synchronization [req-7a053134-30cb-4876-bb79-4a3863b96938 req-24c17968-2295-4039-8f26-0f445fe4a4cc tempest-ServersWithSpecificFlavorTestJSON-1598309329 tempest-ServersWithSpecificFlavorTestJSON-1598309329-project-member] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 952.859556] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 952.860096] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.860284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.860390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.860650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.860813] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.860913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.860971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.861134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.861223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.861316] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.926129] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.926330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.926416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.926573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.926681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.926758] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ba62abf-b989-4453-9509-66329821ead3 is going to be created. [ 952.960620] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.960793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.960897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.961299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.961481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.973344] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: UNINITIALIZED for 2s [ 953.295332] env[61538]: INFO networking_nsxv3.common.synchronization [req-e8c63acb-aa27-4e1b-8592-f5ee89272c71 req-a766d0d4-7a24-4b0f-b08e-d19a8982a9d3 tempest-ServerRescueTestJSON-824602145 tempest-ServerRescueTestJSON-824602145-project-member] Enqueued Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 953.295332] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 with Priority: HIGHEST for action security_group_members [ 953.295582] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-8feb07e8-1e39-437e-8497-dad4b8420d11 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.295706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.295770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.296896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.300092] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.300191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.300269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.300484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.300578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.300683] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8feb07e8-1e39-437e-8497-dad4b8420d11',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.364314] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.367114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.367114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.367114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.367114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.367114] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.367114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.367114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.367114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.368503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.369541] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e is going to be updated. [ 953.404710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.406080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.406080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.406080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.406080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.421688] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: IN_PROGRESS for 2s [ 953.804143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.804403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.804403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.804596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.804688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.804898] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.805025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.805089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.805353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.805430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.805522] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 is going to be updated. [ 953.840453] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.840658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.840936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.841043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.841250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.852890] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: IN_PROGRESS for 2s [ 953.900924] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.901065] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-521" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.901126] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-521" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.901461] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-521" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.905473] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.905718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.905806] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.906135] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.906304] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.906534] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.906636] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.906747] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.906863] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.907148] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.907148] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.907370] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.935486] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.936814] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 953.936814] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.936814] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-521" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.936814] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-b310c98a-9de2-40bc-a430-b4d1724a069b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.937051] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-b310c98a-9de2-40bc-a430-b4d1724a069b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.937051] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-b310c98a-9de2-40bc-a430-b4d1724a069b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.937451] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-b310c98a-9de2-40bc-a430-b4d1724a069b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.937615] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b310c98a-9de2-40bc-a430-b4d1724a069b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.136242] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 in Status: SUCCESS [ 954.136242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.291280] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 954.291280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.291497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.291702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.291899] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.292033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.292101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.292255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.292346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.292419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.292508] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.445609] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.445609] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.445609] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.447054] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.447054] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.447054] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port b310c98a-9de2-40bc-a430-b4d1724a069b not found, creating... [ 954.451456] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.453732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.453732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.453732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.453732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.453732] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.453732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.453732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.454141] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.454341] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.455236] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: b310c98a-9de2-40bc-a430-b4d1724a069b is going to be created. [ 954.482226] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.482226] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.482226] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.482226] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.482226] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.483043] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-b310c98a-9de2-40bc-a430-b4d1724a069b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.797711] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.797847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.797847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.798270] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.798336] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.798407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.798510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.798723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.798723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.798810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.798965] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.799077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.799138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.799285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.800626] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.800626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.800626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.800626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.800626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.800626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.800626] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.982905] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: SUCCESS [ 954.983188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.983346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.984591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.985533] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.985533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.985533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.985533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.985533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.985533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.985767] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.305309] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6798f697-f08e-4d7d-8b6e-6fb13201518f: rpc.has_security_group_logging(os_id): False [ 955.322859] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.323438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.323839] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.326032] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.326032] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.326032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.327184] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.329527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.329527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.329527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.329527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.329527] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 955.408048] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.408048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.408048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.408048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.408048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.423526] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 955.443954] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: SUCCESS [ 955.444176] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e deletion is rescheduled due to dependency. [ 955.444297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.490215] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.675981] env[61538]: INFO networking_nsxv3.common.synchronization [req-e63d778d-9e94-4f97-8973-6e384d2fcfa5 req-f359e5bc-05ca-41b5-a315-13d1c86355ff tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 955.677906] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 955.678058] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.678153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.678153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.679354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.679354] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.679354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.679354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.681909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.681909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.681909] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.868117] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 in Status: SUCCESS [ 955.868278] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8feb07e8-1e39-437e-8497-dad4b8420d11 deletion is rescheduled due to dependency. [ 955.868479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8feb07e8-1e39-437e-8497-dad4b8420d11" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.994982] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ba62abf-b989-4453-9509-66329821ead3: rpc.has_security_group_logging(os_id): False [ 956.018511] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.018688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.018760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.018985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.019094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.019383] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.019497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.019562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.019726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.019804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.020141] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ba62abf-b989-4453-9509-66329821ead3 is going to be created. [ 956.103128] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.103315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.103385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.103656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.104077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.120631] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: IN_PROGRESS for 2s [ 956.184652] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.184900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.184979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.186135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.186135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.186135] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.186135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.186135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.186135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.186444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.186444] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 956.198664] env[61538]: INFO networking_nsxv3.common.synchronization [req-7a053134-30cb-4876-bb79-4a3863b96938 req-cb557c77-9144-48c5-b0a1-aed9de566b78 service nova] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_rules [ 956.198664] env[61538]: INFO networking_nsxv3.common.synchronization [req-7a053134-30cb-4876-bb79-4a3863b96938 req-cb557c77-9144-48c5-b0a1-aed9de566b78 service nova] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 956.198664] env[61538]: INFO networking_nsxv3.common.synchronization [req-7a053134-30cb-4876-bb79-4a3863b96938 req-cb557c77-9144-48c5-b0a1-aed9de566b78 service nova] Enqueued Resource ID: b310c98a-9de2-40bc-a430-b4d1724a069b with Priority: HIGHEST for action port [ 956.200911] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_rules [ 956.200911] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 956.200911] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b310c98a-9de2-40bc-a430-b4d1724a069b with Priority: HIGHEST for action port [ 956.201064] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.201132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.205029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.205029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.205029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.205029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.205029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.205029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.206433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.206738] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.206851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.206916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.207127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.207250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.207352] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.208401] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b310c98a-9de2-40bc-a430-b4d1724a069b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.208523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b310c98a-9de2-40bc-a430-b4d1724a069b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.208586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b310c98a-9de2-40bc-a430-b4d1724a069b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.208770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b310c98a-9de2-40bc-a430-b4d1724a069b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.208843] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b310c98a-9de2-40bc-a430-b4d1724a069b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.267753] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.268054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.268188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.268528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.268769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.281924] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 956.617511] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.617511] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.617511] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.617511] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.617511] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.618509] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.619042] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.619541] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.620083] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.620563] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 956.621530] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.621530] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.623045] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.623045] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 956.623045] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.623045] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.656073] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.656073] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 956.656073] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.656349] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.656586] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-f7745e62-9a91-4729-af18-5a9f49312659 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.657539] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-f7745e62-9a91-4729-af18-5a9f49312659" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.657539] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-f7745e62-9a91-4729-af18-5a9f49312659" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.657539] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-f7745e62-9a91-4729-af18-5a9f49312659" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.657539] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7745e62-9a91-4729-af18-5a9f49312659',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.713925] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.716614] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.716614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.716614] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b310c98a-9de2-40bc-a430-b4d1724a069b with status ACTIVE [ 956.716809] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.716809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.717011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.721282] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.721282] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.721282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.721282] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b310c98a-9de2-40bc-a430-b4d1724a069b is going to be updated. [ 956.748809] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.748986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.749285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.749416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.749591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.749837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b310c98a-9de2-40bc-a430-b4d1724a069b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.159940] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.159940] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.159940] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.160416] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.160416] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.160569] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port f7745e62-9a91-4729-af18-5a9f49312659 not found, creating... [ 957.160829] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.160999] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.161137] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.161363] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.161585] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.161801] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.161984] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.164336] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.165778] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.165778] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.165778] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: f7745e62-9a91-4729-af18-5a9f49312659 is going to be created. [ 957.190411] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.190731] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.190911] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.191251] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.192446] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.192446] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-f7745e62-9a91-4729-af18-5a9f49312659" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.217195] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.358759] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c7f5b645-6f24-45af-9001-fc5be2c3b008 None None] Enqueued Resource ID: 60afcba2-69a6-4c02-9c9e-166a84c3b827 with Priority: HIGHEST for action port [ 957.359488] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60afcba2-69a6-4c02-9c9e-166a84c3b827 with Priority: HIGHEST for action port [ 957.359950] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-60afcba2-69a6-4c02-9c9e-166a84c3b827 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.360292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60afcba2-69a6-4c02-9c9e-166a84c3b827" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.360372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60afcba2-69a6-4c02-9c9e-166a84c3b827" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.360648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60afcba2-69a6-4c02-9c9e-166a84c3b827" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.360775] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60afcba2-69a6-4c02-9c9e-166a84c3b827',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.445143] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 957.445433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.720776] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.721726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.721831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.722263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.722478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.722682] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e is going to be updated. [ 957.785287] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.787820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.788028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.788357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.788595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.803296] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: IN_PROGRESS for 2s [ 957.866909] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60afcba2-69a6-4c02-9c9e-166a84c3b827 [ 957.867313] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.867463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.867594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.867975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.868092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.868253] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60afcba2-69a6-4c02-9c9e-166a84c3b827 already deleted. [ 957.868390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60afcba2-69a6-4c02-9c9e-166a84c3b827" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.139205] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: SUCCESS [ 958.139205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.296291] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 958.296583] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b deletion is rescheduled due to dependency. [ 958.299154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.412069] env[61538]: INFO networking_nsxv3.common.synchronization [req-e63d778d-9e94-4f97-8973-6e384d2fcfa5 req-70414588-f493-48ad-b583-33961183816e service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 958.412275] env[61538]: INFO networking_nsxv3.common.synchronization [req-e63d778d-9e94-4f97-8973-6e384d2fcfa5 req-70414588-f493-48ad-b583-33961183816e service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 958.412432] env[61538]: INFO networking_nsxv3.common.synchronization [req-e63d778d-9e94-4f97-8973-6e384d2fcfa5 req-70414588-f493-48ad-b583-33961183816e service nova] Enqueued Resource ID: f7745e62-9a91-4729-af18-5a9f49312659 with Priority: HIGHEST for action port [ 958.412650] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 958.412778] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 958.412876] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7745e62-9a91-4729-af18-5a9f49312659 with Priority: HIGHEST for action port [ 958.413667] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.413796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.413857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.415701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.415833] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.416878] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.417070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.420616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.420616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.420616] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.420616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.420616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.420616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.420616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.420616] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.420616] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7745e62-9a91-4729-af18-5a9f49312659 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.420616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7745e62-9a91-4729-af18-5a9f49312659" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.420616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7745e62-9a91-4729-af18-5a9f49312659" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.420616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7745e62-9a91-4729-af18-5a9f49312659" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.420616] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7745e62-9a91-4729-af18-5a9f49312659',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.928097] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.928097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.928097] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.928097] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7745e62-9a91-4729-af18-5a9f49312659 with status ACTIVE [ 958.928097] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.928097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.928097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.928097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.928097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.929157] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.929540] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.930436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.930436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.930436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.930436] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.930436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.930700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.930965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.931559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.931938] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7745e62-9a91-4729-af18-5a9f49312659 is going to be updated. [ 958.966341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.966341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.966341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.966341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.966341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.966341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7745e62-9a91-4729-af18-5a9f49312659" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.362823] env[61538]: INFO networking_nsxv3.common.synchronization [req-93c59ed0-d893-4e4f-b3ef-e7bdb6bcf896 req-d9628d75-a231-4360-ae73-361f5937ed88 tempest-ListServerFiltersTestJSON-816069453 tempest-ListServerFiltersTestJSON-816069453-project-member] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 959.363523] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 959.364553] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.364553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.364553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.364743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.364825] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.365476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.365750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.366105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.366228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.366342] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.435133] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.520882] env[61538]: INFO networking_nsxv3.common.synchronization [None req-965c78e1-17a4-4751-8de2-15043ae2a1e9 None None] Enqueued Resource ID: ee64fcf2-70fa-4d2c-a276-e9b454e546d9 with Priority: HIGHEST for action port [ 959.521263] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee64fcf2-70fa-4d2c-a276-e9b454e546d9 with Priority: HIGHEST for action port [ 959.521658] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee64fcf2-70fa-4d2c-a276-e9b454e546d9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.521879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee64fcf2-70fa-4d2c-a276-e9b454e546d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.521995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee64fcf2-70fa-4d2c-a276-e9b454e546d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.522307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee64fcf2-70fa-4d2c-a276-e9b454e546d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.522470] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee64fcf2-70fa-4d2c-a276-e9b454e546d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.547913] env[61538]: INFO networking_nsxv3.common.synchronization [req-59d6fbcf-ec6b-4843-850d-9fb2aebd7c29 req-4749827a-99de-4f7c-af60-dc39b845106a tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 959.548479] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 959.548835] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.548994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.548994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.549612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.549797] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.549912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.549968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.551492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.551492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.551492] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.815884] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: SUCCESS [ 959.815884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.815884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.816139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.817503] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.817503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.817503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.817503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.817503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.817503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.817503] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.873029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.937075] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.937320] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.937551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.937639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.937725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.937822] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 959.966800] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.966986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.966986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.967368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.967494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.976604] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 960.026018] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee64fcf2-70fa-4d2c-a276-e9b454e546d9 [ 960.026018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.026556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.026702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.027062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.027266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.027438] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee64fcf2-70fa-4d2c-a276-e9b454e546d9 already deleted. [ 960.027568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee64fcf2-70fa-4d2c-a276-e9b454e546d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.043052] env[61538]: INFO networking_nsxv3.common.synchronization [req-354baf4a-e8c6-4128-949d-4de0e2e67314 req-ea058ed6-8142-4fd9-9023-09cce3d69da9 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 960.043282] env[61538]: INFO networking_nsxv3.common.synchronization [req-354baf4a-e8c6-4128-949d-4de0e2e67314 req-ea058ed6-8142-4fd9-9023-09cce3d69da9 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 960.043788] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 960.043929] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 960.044277] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.044409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.044495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.044766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.044952] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.045079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.045141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.045307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.045387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.045491] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.046869] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.047031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.047093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.047296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.047460] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.047640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.047640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.047907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.047907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.048022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.053754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.053954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.054063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.054301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.054405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.054633] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.054750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.054855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.054976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.055104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.055150] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 960.101947] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.102180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.102271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.102587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.102802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.114559] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 960.269023] env[61538]: INFO networking_nsxv3.common.synchronization [req-354baf4a-e8c6-4128-949d-4de0e2e67314 req-ea058ed6-8142-4fd9-9023-09cce3d69da9 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_rules [ 960.269255] env[61538]: INFO networking_nsxv3.common.synchronization [req-354baf4a-e8c6-4128-949d-4de0e2e67314 req-ea058ed6-8142-4fd9-9023-09cce3d69da9 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 960.269429] env[61538]: INFO networking_nsxv3.common.synchronization [req-354baf4a-e8c6-4128-949d-4de0e2e67314 req-ea058ed6-8142-4fd9-9023-09cce3d69da9 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 960.269568] env[61538]: INFO networking_nsxv3.common.synchronization [req-354baf4a-e8c6-4128-949d-4de0e2e67314 req-ea058ed6-8142-4fd9-9023-09cce3d69da9 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 960.269713] env[61538]: INFO networking_nsxv3.common.synchronization [req-354baf4a-e8c6-4128-949d-4de0e2e67314 req-ea058ed6-8142-4fd9-9023-09cce3d69da9 tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 with Priority: HIGHEST for action port [ 960.270538] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_rules [ 960.270671] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 960.270767] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 with Priority: HIGHEST for action port [ 960.270871] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 960.271008] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 960.271428] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.272554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.272554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.272554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.272554] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.273285] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.273285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.273402] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.273524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.273599] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.276341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.276423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.276459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.276740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.276740] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ea1dae1-c4a7-423c-9d65-dbc15e4848b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.279216] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.279216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.279216] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.279216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.320823] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.376347] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.409643] env[61538]: INFO networking_nsxv3.common.synchronization [None req-54239122-83e7-4a2f-b620-0d043de090fa tempest-ServersTestBootFromVolume-2047470289 tempest-ServersTestBootFromVolume-2047470289-project-member] Enqueued Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_rules [ 960.410266] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_rules [ 960.410930] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16598403-384b-4b7b-9e19-2f2d3b7596b6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.411361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.411476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.411766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.412016] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.549306] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.550530] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.626473] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.626707] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.626927] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.627515] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.627901] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.628148] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.628343] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.628649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.628893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.629211] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.629379] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.629524] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.629666] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.629842] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.630163] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.630369] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.663198] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.663697] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.663697] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.663857] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.664215] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.664444] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.664577] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.664940] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.665097] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfbfdd5b-df4f-4326-b48a-69bd14494d5a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.721459] env[61538]: INFO networking_nsxv3.common.synchronization [None req-6f57c806-9b12-42bb-84d0-4bda5469e0c4 tempest-ServersTestBootFromVolume-2047470289 tempest-ServersTestBootFromVolume-2047470289-project-member] Enqueued Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_rules [ 960.722104] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_rules [ 960.722423] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16598403-384b-4b7b-9e19-2f2d3b7596b6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.722537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.780426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.780603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.780904] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.780997] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.781166] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 with status ACTIVE [ 960.781349] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.781481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.781561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.781859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.781968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.782337] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.782443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.782501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.782717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.782773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.783193] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.783193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.783193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.783337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.783337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.783429] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 is going to be updated. [ 960.813225] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.813414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.813481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.813645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.813792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.814065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.825677] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 463a8c39-ee54-4fb8-a9f5-3967b4233a2e: rpc.has_security_group_logging(os_id): False [ 960.847021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.847201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.847282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.847600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.847752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.847979] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.848107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.848181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.848373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.848456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.848547] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e is going to be updated. [ 960.882787] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.882787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.882787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.883066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.883066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.883129] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be updated. [ 960.932736] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.932736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.932736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.932936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.933087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.949215] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 960.950833] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.950995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.951159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.951457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.951647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.951790] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 already deleted. [ 960.951919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.952119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.952332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.952498] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.954707] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.954898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.955016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.955328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.955516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.967253] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: IN_PROGRESS for 2s [ 961.057651] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.057651] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.170875] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.171141] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.172024] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.172232] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.172295] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.172653] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port dfbfdd5b-df4f-4326-b48a-69bd14494d5a not found, creating... [ 961.173043] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.174164] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.174164] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.174164] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.174164] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.174164] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.174555] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.174555] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.174769] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.174922] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.175279] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: dfbfdd5b-df4f-4326-b48a-69bd14494d5a is going to be created. [ 961.204714] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.205318] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.205318] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.205607] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.205892] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.206838] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.480454] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.480830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.480830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.482093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.482286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.482561] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 already deleted. [ 961.482702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.559422] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.559633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.559714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.560261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.560261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.560261] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca is going to be created. [ 961.561642] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.561767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.561834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.562386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.562650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.562727] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 961.635778] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.635989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.635989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.636374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.638022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.644775] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.644775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.644992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.645452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.646368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.649530] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: UNINITIALIZED for 2s [ 961.661195] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 961.990995] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 961.991262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.991451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.991764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.991883] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.992013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.992080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.992241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.992327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.992415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.992506] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.125317] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 962.125497] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 962.125611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.167888] env[61538]: INFO networking_nsxv3.common.synchronization [None req-7226a4c4-ee62-45f1-a149-b7ef577c7af9 None None] Enqueued Resource ID: 6b82b007-dee4-4022-8300-a0f85b1ef0f3 with Priority: HIGHEST for action port [ 962.168491] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b82b007-dee4-4022-8300-a0f85b1ef0f3 with Priority: HIGHEST for action port [ 962.168863] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b82b007-dee4-4022-8300-a0f85b1ef0f3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.168993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b82b007-dee4-4022-8300-a0f85b1ef0f3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.169409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b82b007-dee4-4022-8300-a0f85b1ef0f3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.169712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b82b007-dee4-4022-8300-a0f85b1ef0f3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.169796] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b82b007-dee4-4022-8300-a0f85b1ef0f3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.428371] env[61538]: INFO networking_nsxv3.common.synchronization [req-59d6fbcf-ec6b-4843-850d-9fb2aebd7c29 req-b4128832-be53-4c9e-9d9b-052b8dddf031 service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 962.428596] env[61538]: INFO networking_nsxv3.common.synchronization [req-59d6fbcf-ec6b-4843-850d-9fb2aebd7c29 req-b4128832-be53-4c9e-9d9b-052b8dddf031 service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 962.428774] env[61538]: INFO networking_nsxv3.common.synchronization [req-59d6fbcf-ec6b-4843-850d-9fb2aebd7c29 req-b4128832-be53-4c9e-9d9b-052b8dddf031 service nova] Enqueued Resource ID: dfbfdd5b-df4f-4326-b48a-69bd14494d5a with Priority: HIGHEST for action port [ 962.429612] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 962.429752] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 962.429840] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbfdd5b-df4f-4326-b48a-69bd14494d5a with Priority: HIGHEST for action port [ 962.430342] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.430342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.430770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.430770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.430770] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.434972] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.434972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.434972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.434972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.434972] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.434972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.434972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.434972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.434972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.434972] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.434972] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.435555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.435555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.435555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.435555] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfbfdd5b-df4f-4326-b48a-69bd14494d5a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.496117] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.496479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.496479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.496597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.496787] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.496901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.496963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.497150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.497299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.497365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.497566] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.497887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.497887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.497887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.498036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.498091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.498146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.498328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.498412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.498495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.498587] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.674500] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b82b007-dee4-4022-8300-a0f85b1ef0f3 [ 962.674748] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.674909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.674978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.675235] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.675324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.675441] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b82b007-dee4-4022-8300-a0f85b1ef0f3 already deleted. [ 962.675525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b82b007-dee4-4022-8300-a0f85b1ef0f3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.934204] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.934379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.939366] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.939890] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfbfdd5b-df4f-4326-b48a-69bd14494d5a with status ACTIVE [ 962.940222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.940355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.940355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.940614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.940676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.940866] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.940947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.941082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.941183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.941264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.941452] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.941548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.941610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.945259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.945383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.945586] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfbfdd5b-df4f-4326-b48a-69bd14494d5a is going to be updated. [ 962.967117] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 962.967402] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.977348] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.977582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.977667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.977844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.978640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.979225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfbfdd5b-df4f-4326-b48a-69bd14494d5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.986203] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: SUCCESS [ 962.986560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.002463] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b: rpc.has_security_group_logging(os_id): False [ 963.033113] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.034214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.034214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.034214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.034214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.034214] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.034712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.034712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.034712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.034712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.042393] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.042393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.042393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.042393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.042393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.042811] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.042898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.042951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.043342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.043342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.043342] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 963.147840] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.148736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.148736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.148736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.148979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.169719] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 963.453427] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.664455] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: SUCCESS [ 963.664455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.665506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.665779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.665940] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.668629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.668629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.668629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.668629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.668929] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.681079] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 963.681411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.681622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.682061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.682628] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.682628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.682628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.682861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.682861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.682861] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.957543] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.957728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.957786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.958092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.958201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.958296] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 964.001692] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.001692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.001692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.001692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.001692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.011467] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 964.172354] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.187516] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.573040] env[61538]: INFO networking_nsxv3.common.synchronization [None req-3558f8aa-b484-4937-855b-a4d085507499 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_rules [ 964.573813] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_rules [ 964.574629] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.574961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.574961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.575163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.575245] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.679319] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.690430] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.791141] env[61538]: INFO networking_nsxv3.common.synchronization [None req-42ad22b9-963b-49dd-a735-7068dfe7a433 None None] Enqueued Resource ID: a32513f8-145a-450d-bdb2-f8ba4ed4fcdc with Priority: HIGHEST for action port [ 964.791860] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a32513f8-145a-450d-bdb2-f8ba4ed4fcdc with Priority: HIGHEST for action port [ 964.792253] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a32513f8-145a-450d-bdb2-f8ba4ed4fcdc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.792388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a32513f8-145a-450d-bdb2-f8ba4ed4fcdc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.792872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a32513f8-145a-450d-bdb2-f8ba4ed4fcdc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.792872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a32513f8-145a-450d-bdb2-f8ba4ed4fcdc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.792872] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a32513f8-145a-450d-bdb2-f8ba4ed4fcdc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.117806] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.117806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.117806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.118073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.118117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.118254] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c already deleted. [ 965.118345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.127029] env[61538]: INFO networking_nsxv3.common.synchronization [None req-4eea1a2f-d432-4607-831b-564e37cdeec5 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_rules [ 965.128285] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_rules [ 965.128631] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.128702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.128883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.128967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.129062] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.181009] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.181223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.181297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.181578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.181703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.181847] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca is going to be updated. [ 965.195726] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.196040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.196040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.196195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.196342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.196465] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 965.201680] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 965.201934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.217831] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.218022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.218022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.218837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.219129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.228221] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: IN_PROGRESS for 2s [ 965.238887] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.239096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.239184] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.239439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.239669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.252491] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 965.299071] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a32513f8-145a-450d-bdb2-f8ba4ed4fcdc [ 965.299071] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.299071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.299071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.299071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.299071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.299071] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a32513f8-145a-450d-bdb2-f8ba4ed4fcdc already deleted. [ 965.299071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a32513f8-145a-450d-bdb2-f8ba4ed4fcdc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.654623] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.654772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.654843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.655189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.655335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.655404] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c already deleted. [ 965.655493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.026179] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 966.035379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.035379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.035379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.035379] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.043387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.043387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.043387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.043387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.043387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.043387] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.412036] env[61538]: INFO networking_nsxv3.common.synchronization [req-ffb2bada-2ab3-4a1d-838d-57b8c60dec89 req-70386dc8-a3c7-41c8-be75-0ccadc6c2da8 tempest-ServersAdminTestJSON-1231961305 tempest-ServersAdminTestJSON-1231961305-project-member] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 966.416025] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 966.416025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.416025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.416025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.416025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.416025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.416025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.416025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.416025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.416844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.416844] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.458920] env[61538]: INFO networking_nsxv3.common.synchronization [req-6a1d7ad4-d6da-4a20-86d8-c47264d999e0 req-e4366db3-3472-41d0-a388-d04ee5a52861 tempest-VolumesAdminNegativeTest-2067435148 tempest-VolumesAdminNegativeTest-2067435148-project-member] Enqueued Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_members [ 966.459610] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGHEST for action security_group_members [ 966.460264] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.460394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.460466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.460673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.460825] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.460929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.460992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.461192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.461293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.461691] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.550508] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.550633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.550712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.550996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.551108] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.551212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.551277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.551425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.551518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.551606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.551758] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.551869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.551963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.552080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.552220] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.552316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.552753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.552753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.552753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.552753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.552753] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.923726] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.965893] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.965893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.965893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.965893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.965893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.965893] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.965893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.965893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.966393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.966393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.966393] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e is going to be updated. [ 967.019910] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.020444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.020612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.020939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.021240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.034310] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e in Status: IN_PROGRESS for 2s [ 967.059588] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fcbd20b-13e3-44c4-bf9a-746a1da000dc: rpc.has_security_group_logging(os_id): False [ 967.079819] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.079992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.080104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.080281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.080432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.080567] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.080679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.080755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.080914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.080988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.081191] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.081955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.081955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.081955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.081955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.081955] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.081955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.081955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.082209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.082209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.082209] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 967.189055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.189263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.189263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.189852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.189852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.225741] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 967.242881] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: SUCCESS [ 967.243908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.243908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.243908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.243908] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.244181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.244181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.244243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.244328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.244415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.244515] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.266256] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 967.266256] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.266256] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.266549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.266732] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.267126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.267126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.267290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.267685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.267685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.267685] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.325250] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.325250] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.325250] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.326509] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.326509] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.326509] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.326509] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.326859] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.326859] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.327184] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.327184] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.327657] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.327784] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.327882] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.328034] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.328327] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.364676] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.364790] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 967.367053] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.367053] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-644" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.367053] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.367053] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.367053] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.367053] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.367053] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eae1f8ca-5ff6-4f95-8ff5-9a4452601a17',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.426498] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.587550] env[61538]: INFO networking_nsxv3.common.synchronization [None req-4864fe01-c2db-499d-b8be-e2f3405974d7 None None] Enqueued Resource ID: 2fba867c-604e-48ac-a51b-454de15bbb8f with Priority: HIGHEST for action port [ 967.588187] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fba867c-604e-48ac-a51b-454de15bbb8f with Priority: HIGHEST for action port [ 967.588605] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fba867c-604e-48ac-a51b-454de15bbb8f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.588734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fba867c-604e-48ac-a51b-454de15bbb8f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.589043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fba867c-604e-48ac-a51b-454de15bbb8f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.591554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fba867c-604e-48ac-a51b-454de15bbb8f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.591730] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fba867c-604e-48ac-a51b-454de15bbb8f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.746419] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.771166] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.771166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.771166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.771166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.771653] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.771653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.771653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.771780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.771780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.774516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.774516] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.774516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.774516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.774516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.774516] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.774516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.774516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.774516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.774516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.774516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.774516] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.869565] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.869818] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.869980] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.870640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.870640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.870640] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port eae1f8ca-5ff6-4f95-8ff5-9a4452601a17 not found, creating... [ 967.870935] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.871447] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.871447] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.871447] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.872147] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.872147] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.873248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.873580] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.873825] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.873980] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.874151] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: eae1f8ca-5ff6-4f95-8ff5-9a4452601a17 is going to be created. [ 967.911246] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.911603] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.911692] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.911974] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.912211] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.912481] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.928960] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.928960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.928960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.929161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.929272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.929372] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 967.970426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.970567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.970635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.970850] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.971028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.986604] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 968.094879] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fba867c-604e-48ac-a51b-454de15bbb8f [ 968.095245] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.095346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.095428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.095657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.095741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.095853] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fba867c-604e-48ac-a51b-454de15bbb8f already deleted. [ 968.095919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fba867c-604e-48ac-a51b-454de15bbb8f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.248353] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 575a9d53-3464-492c-a0bb-d9d7bb8b0eca: rpc.has_security_group_logging(os_id): False [ 968.268728] env[61538]: INFO networking_nsxv3.common.synchronization [req-38fe0b8d-f883-400b-9ee5-52c178c8af17 req-8f904a13-f32e-4381-8967-ada1d5b25993 tempest-ImagesOneServerNegativeTestJSON-513524542 tempest-ImagesOneServerNegativeTestJSON-513524542-project-member] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 968.271160] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.271836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.271995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.272870] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.272870] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.274194] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.276023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.276274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.276341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.276432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.276564] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca is going to be created. [ 968.278061] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 968.278461] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6798f697-f08e-4d7d-8b6e-6fb13201518f: rpc.has_security_group_logging(os_id): False [ 968.279634] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.279634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.279979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.280375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.280453] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.281042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.281042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.281042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.281042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.281042] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.305128] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.307812] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.307812] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.307812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.308523] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.308523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.309160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.309453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.310418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.310418] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 968.345552] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.345684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.347741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.347741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.347741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.366632] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: IN_PROGRESS for 2s [ 968.404228] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.404653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.407018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.407018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.407018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.427501] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 968.789536] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.789743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.789819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.790100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.790205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.790454] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.790613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.790613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.790786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.790878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.790966] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c already deleted. [ 968.791087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.046064] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e in Status: SUCCESS [ 969.046273] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e deletion is rescheduled due to dependency. [ 969.046359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.246320] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 969.246613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.250446] env[61538]: INFO networking_nsxv3.common.synchronization [req-ffb2bada-2ab3-4a1d-838d-57b8c60dec89 req-860c3b6d-a757-46fa-ad8a-564cbd187672 service nova] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_rules [ 969.251335] env[61538]: INFO networking_nsxv3.common.synchronization [req-ffb2bada-2ab3-4a1d-838d-57b8c60dec89 req-860c3b6d-a757-46fa-ad8a-564cbd187672 service nova] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 969.251335] env[61538]: INFO networking_nsxv3.common.synchronization [req-ffb2bada-2ab3-4a1d-838d-57b8c60dec89 req-860c3b6d-a757-46fa-ad8a-564cbd187672 service nova] Enqueued Resource ID: eae1f8ca-5ff6-4f95-8ff5-9a4452601a17 with Priority: HIGHEST for action port [ 969.251335] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_rules [ 969.251772] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 969.251772] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eae1f8ca-5ff6-4f95-8ff5-9a4452601a17 with Priority: HIGHEST for action port [ 969.254715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.254888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.255024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.255254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.255383] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.256381] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.256480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.256754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.256868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.256932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.257130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.257205] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eae1f8ca-5ff6-4f95-8ff5-9a4452601a17',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.339111] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.339721] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.339721] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.339973] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.341601] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.341601] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.341601] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.341911] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.341911] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.342193] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.342316] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.342435] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.342547] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.342678] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.342765] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.342900] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.364009] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.364214] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.364366] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.364584] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.364928] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-2019c08e-1b99-4d7b-96f0-32e559d30daf taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.365221] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-2019c08e-1b99-4d7b-96f0-32e559d30daf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.365601] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-2019c08e-1b99-4d7b-96f0-32e559d30daf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.366933] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-2019c08e-1b99-4d7b-96f0-32e559d30daf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.367175] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2019c08e-1b99-4d7b-96f0-32e559d30daf',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.760117] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.760257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.760506] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eae1f8ca-5ff6-4f95-8ff5-9a4452601a17 with status ACTIVE [ 969.760786] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.760874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.760940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.761256] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.761336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.761526] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.761635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.761689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.761841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.761938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.762157] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.762272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.762339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.762518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.762610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.762715] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eae1f8ca-5ff6-4f95-8ff5-9a4452601a17 is going to be updated. [ 969.787999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.787999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.787999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.787999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.787999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.787999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eae1f8ca-5ff6-4f95-8ff5-9a4452601a17" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.870870] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.871217] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.871332] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.871643] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.871803] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.871974] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 2019c08e-1b99-4d7b-96f0-32e559d30daf not found, creating... [ 969.872286] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.872460] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.872628] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.872909] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.873198] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.874521] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.875051] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.875413] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.875835] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.876248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.876584] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 2019c08e-1b99-4d7b-96f0-32e559d30daf is going to be created. [ 969.916983] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.917546] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.917866] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.918302] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.918599] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.918896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-2019c08e-1b99-4d7b-96f0-32e559d30daf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.003106] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 970.003106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.003106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.004935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.005733] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.005733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.005733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.005733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.005733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.005947] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.380896] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: SUCCESS [ 970.381311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.451383] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 970.451687] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 970.452265] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe with Priority: HIGHEST for action security_group_members [ 970.458758] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 970.458758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.458758] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 970.459103] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 970.459103] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe with Priority: HIGHEST for action security_group_members [ 970.459412] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.459581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.459668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.459934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.464028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.464028] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.464028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.464028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.464028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.464028] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.464960] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.464960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.465083] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.465382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.465450] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.465525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.465576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.465693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.465770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.465859] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.509078] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.707058] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_rules [ 970.707058] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 970.707058] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 970.707058] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 970.707058] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe with Priority: HIGHEST for action security_group_rules [ 970.707635] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe with Priority: HIGHEST for action security_group_members [ 970.707787] env[61538]: INFO networking_nsxv3.common.synchronization [req-f3f242b9-122e-47eb-901c-6d5b03c33294 req-de70538c-363c-4f97-8ad6-62630c8c952a tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 with Priority: HIGHEST for action port [ 970.708334] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_rules [ 970.708575] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_rules [ 970.708653] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe with Priority: HIGHEST for action security_group_members [ 970.708724] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 with Priority: HIGHEST for action port [ 970.708779] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe with Priority: HIGHEST for action security_group_rules [ 970.708864] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 970.708950] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 970.709240] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.709369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.709436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.709639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.709720] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.711153] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.711428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.711509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.711937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.711937] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.713477] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.713477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.713639] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.713731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.713761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.714028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.714028] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ea1dae1-c4a7-423c-9d65-dbc15e4848b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.718398] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.718559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.718622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.718813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.719158] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.720933] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.721125] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.721410] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.721591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.970115] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.970115] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.970115] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.013035] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.046913] env[61538]: INFO networking_nsxv3.common.synchronization [None req-5c6e6967-2ae2-4403-9bf7-ac0b9c661ef4 None None] Enqueued Resource ID: 5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738 with Priority: HIGHEST for action port [ 971.047772] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738 with Priority: HIGHEST for action port [ 971.048501] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.048827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.049025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.049395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.049643] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.223024] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 with status ACTIVE [ 971.223024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.223024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.223024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.223024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.223024] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ea1dae1-c4a7-423c-9d65-dbc15e4848b1 is going to be updated. [ 971.224370] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.224683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.225081] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.225408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.225765] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.226013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.267208] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.267208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.267208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.267208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.267208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.267208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ea1dae1-c4a7-423c-9d65-dbc15e4848b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.470926] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.474223] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.476041] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.518209] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.518209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.518209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.518209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.518209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.518209] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 971.550887] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.551108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.551750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.551750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.551750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.552949] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738 [ 971.554600] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.554771] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.554864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.554996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.555122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.555194] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738 already deleted. [ 971.555467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ed0d0dd-c8bc-4fef-8ff5-e6ea82a17738" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.565967] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 971.603255] env[61538]: INFO networking_nsxv3.common.synchronization [req-d6d1cdfd-af99-4177-bbce-d5488be857d5 req-ec3d4158-5d4b-4379-909a-a108343fe8d6 tempest-ServersNegativeTestJSON-1742660343 tempest-ServersNegativeTestJSON-1742660343-project-member] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 971.603847] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 971.604343] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.604605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.604605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.604784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.604921] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.606228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.606228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.606228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.606228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.606228] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.610077] env[61538]: INFO networking_nsxv3.common.synchronization [req-38fe0b8d-f883-400b-9ee5-52c178c8af17 req-3e815577-9d1e-47cd-8499-2c40a20966c0 service nova] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_rules [ 971.610667] env[61538]: INFO networking_nsxv3.common.synchronization [req-38fe0b8d-f883-400b-9ee5-52c178c8af17 req-3e815577-9d1e-47cd-8499-2c40a20966c0 service nova] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 971.610858] env[61538]: INFO networking_nsxv3.common.synchronization [req-38fe0b8d-f883-400b-9ee5-52c178c8af17 req-3e815577-9d1e-47cd-8499-2c40a20966c0 service nova] Enqueued Resource ID: 2019c08e-1b99-4d7b-96f0-32e559d30daf with Priority: HIGHEST for action port [ 971.612398] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_rules [ 971.612535] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 971.612664] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2019c08e-1b99-4d7b-96f0-32e559d30daf with Priority: HIGHEST for action port [ 971.615100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.615100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.615100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.615100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.615100] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.615100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.615100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.615100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.615100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.615100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.615100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.615100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.615100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.615844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.615844] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.617192] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2019c08e-1b99-4d7b-96f0-32e559d30daf taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.617192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2019c08e-1b99-4d7b-96f0-32e559d30daf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.617192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2019c08e-1b99-4d7b-96f0-32e559d30daf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.617192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2019c08e-1b99-4d7b-96f0-32e559d30daf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.617192] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2019c08e-1b99-4d7b-96f0-32e559d30daf',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.978557] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.978557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.978557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.978557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.978557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.978557] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 971.979663] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.979862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.979973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.980259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.980557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.980712] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca is going to be updated. [ 971.982021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.982395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.982520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.982938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.983122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.983264] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe is going to be created. [ 972.038652] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.039293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.039403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.039626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.039801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.044281] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.044582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.044711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.044992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.045255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.047839] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.048126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.048255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.048509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.048704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.053145] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe in Status: UNINITIALIZED for 2s [ 972.059674] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 972.060818] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: IN_PROGRESS for 2s [ 972.112398] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.125974] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.127271] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.127271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.127447] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2019c08e-1b99-4d7b-96f0-32e559d30daf with status ACTIVE [ 972.127523] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.127665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.127750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.127982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.129284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.129602] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.130938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.131291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.131552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.131700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.132575] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.132897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.132897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.134178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.134295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.134396] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2019c08e-1b99-4d7b-96f0-32e559d30daf is going to be updated. [ 972.163977] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.164192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.164286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.164611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.164842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.165127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2019c08e-1b99-4d7b-96f0-32e559d30daf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.389703] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-45 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.389703] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.389703] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.392231] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.392612] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.392816] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.392961] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.393242] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.393401] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.393926] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.393926] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.393926] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.394095] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.394124] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.394382] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.394382] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.422350] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.422548] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.422853] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.422853] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.423187] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-28a12f95-4a10-42db-ac3a-4fe609682144 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.423371] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-28a12f95-4a10-42db-ac3a-4fe609682144" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.423500] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-28a12f95-4a10-42db-ac3a-4fe609682144" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.423841] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-28a12f95-4a10-42db-ac3a-4fe609682144" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.423994] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28a12f95-4a10-42db-ac3a-4fe609682144',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.616751] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.636682] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.926998] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.927416] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.927592] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.927918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.928101] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.928275] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 28a12f95-4a10-42db-ac3a-4fe609682144 not found, creating... [ 972.928567] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.928779] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.928960] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.929252] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.929419] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.929783] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.929958] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.930404] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.930671] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.930841] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.930994] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 28a12f95-4a10-42db-ac3a-4fe609682144 is going to be created. [ 972.965549] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.965827] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.965984] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.966377] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.966681] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.966995] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-28a12f95-4a10-42db-ac3a-4fe609682144" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.120387] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.120611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.120675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.121117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.121206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.122308] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be updated. [ 973.139910] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.140510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.140660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.141800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.141800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.141800] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be created. [ 973.170025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.170197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.170267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.170503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.170645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.176988] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.176988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.176988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.176988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.176988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.189443] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: UNINITIALIZED for 2s [ 973.190648] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: IN_PROGRESS for 2s [ 973.585084] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 973.585084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.591028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.591028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.591028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.591028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.591028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.591028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.591028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.591028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.591028] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.075053] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe in Status: SUCCESS [ 974.075053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.075053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.075053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.075053] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.075053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.075053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.075053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.075053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.075053] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.077247] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 974.077708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.078759] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: SUCCESS [ 974.079109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.080079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.080079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.080079] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.080079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.080079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.080551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.084088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.084088] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.084088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.084088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.084088] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.084088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.084088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.084088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.084088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.084088] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.098036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.098036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.098036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.098036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.098036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.098688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.098688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.098688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.098688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.098688] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.128365] env[61538]: INFO networking_nsxv3.common.synchronization [req-d6d1cdfd-af99-4177-bbce-d5488be857d5 req-b49a766c-eb5b-41bf-ab53-9a156dd4090f service nova] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_rules [ 974.128365] env[61538]: INFO networking_nsxv3.common.synchronization [req-d6d1cdfd-af99-4177-bbce-d5488be857d5 req-b49a766c-eb5b-41bf-ab53-9a156dd4090f service nova] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 974.128365] env[61538]: INFO networking_nsxv3.common.synchronization [req-d6d1cdfd-af99-4177-bbce-d5488be857d5 req-b49a766c-eb5b-41bf-ab53-9a156dd4090f service nova] Enqueued Resource ID: 28a12f95-4a10-42db-ac3a-4fe609682144 with Priority: HIGHEST for action port [ 974.128365] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_rules [ 974.128365] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 974.128365] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a12f95-4a10-42db-ac3a-4fe609682144 with Priority: HIGHEST for action port [ 974.128962] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.129247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.132107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.132107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.132107] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.132107] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.132107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.132107] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-28a12f95-4a10-42db-ac3a-4fe609682144 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.132107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28a12f95-4a10-42db-ac3a-4fe609682144" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.132107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28a12f95-4a10-42db-ac3a-4fe609682144" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.132107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28a12f95-4a10-42db-ac3a-4fe609682144" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.132107] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28a12f95-4a10-42db-ac3a-4fe609682144',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.154251] env[61538]: INFO networking_nsxv3.common.synchronization [req-d3d25e4a-0bf3-4ebd-9dfd-d2a129960f31 req-6656aa77-f096-46cf-9222-612439ae76db tempest-MigrationsAdminTest-1836932771 tempest-MigrationsAdminTest-1836932771-project-member] Enqueued Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 974.154251] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 974.154887] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.158027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.158027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.158027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.158027] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.158027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.158027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.158027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.158027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.158027] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.584850] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.585939] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.586895] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.600114] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e4fbaf8-8019-44da-bb3b-478c3b16eb47: rpc.has_security_group_logging(os_id): False [ 974.622968] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.623617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.623617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.623617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.624380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.624380] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.624380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.624380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.624380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.624564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.624656] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.624785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.624857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.625045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.625145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.625481] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.625610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.625690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.625879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.625975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.626097] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 974.634222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.634362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.634593] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28a12f95-4a10-42db-ac3a-4fe609682144 with status ACTIVE [ 974.634811] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.634943] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.635041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.635330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.635441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.635666] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.635791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.635874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.636085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.636188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.636437] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.636560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.636633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.636807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.636904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.637022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28a12f95-4a10-42db-ac3a-4fe609682144 is going to be updated. [ 974.658738] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.658941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.658991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.659268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.659443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.659668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28a12f95-4a10-42db-ac3a-4fe609682144" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.659960] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.700040] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.700181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.700181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.700421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.700570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.721104] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 975.089041] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.093232] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.094239] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.101586] env[61538]: INFO networking_nsxv3.common.synchronization [req-0d68f5bd-c985-4ad7-8f13-b96f147887f1 req-7a6bcd4d-2a00-4882-a627-7d9b1b149a2d tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 975.101819] env[61538]: INFO networking_nsxv3.common.synchronization [req-0d68f5bd-c985-4ad7-8f13-b96f147887f1 req-7a6bcd4d-2a00-4882-a627-7d9b1b149a2d tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 975.101955] env[61538]: INFO networking_nsxv3.common.synchronization [req-0d68f5bd-c985-4ad7-8f13-b96f147887f1 req-7a6bcd4d-2a00-4882-a627-7d9b1b149a2d tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe with Priority: HIGHEST for action security_group_members [ 975.102473] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGHEST for action security_group_members [ 975.102613] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 975.102714] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe with Priority: HIGHEST for action security_group_members [ 975.102986] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.103171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.103395] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.103487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.103664] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.103761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.161755] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.210242] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 975.210502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.211339] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 975.211533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.212013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.212355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.213387] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.213387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.213387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.213387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.213387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.213387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.213387] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.214527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.214729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.214945] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.215096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.215199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.215443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.215532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.215624] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.595676] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.596486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.596486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.599169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.599169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.599169] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 975.600425] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.600702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.600830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.601192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.601360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.601527] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe is going to be updated. [ 975.606290] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.606549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.606693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.607020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.607170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.607388] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca is going to be updated. [ 975.664506] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.664969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.664969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.665659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.665825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.666042] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 580370e7-ea25-4027-912b-de772679071c is going to be updated. [ 975.669223] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.669416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.669643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.669769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.669905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.673946] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.674215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.674215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.674461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.674698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.677845] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.677845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.677845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.677845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.677845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.694570] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: IN_PROGRESS for 2s [ 975.695725] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe in Status: IN_PROGRESS for 2s [ 975.697262] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 975.718083] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.721055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.721055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.721055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.721055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.721777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.721777] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.722426] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.724878] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.725273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.725453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.725834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.726077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.739563] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: IN_PROGRESS for 2s [ 976.226973] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11ca0972-f93e-4e78-b9f2-0d09798b331c: rpc.has_security_group_logging(os_id): False [ 976.232503] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.248866] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.249178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.249272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.249605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.249695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.249967] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.250126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.250198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.250389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.250514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.250742] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.250845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.250987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.252137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.252245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.256223] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.256444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.256537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.256785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.256884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.256987] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be created. [ 976.356466] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.356649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.356713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.356985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.357690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.388507] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: IN_PROGRESS for 2s [ 976.737054] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.737054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.737054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.737054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.737054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.737054] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be updated. [ 976.740432] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 976.741173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.783031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.785955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.785955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.785955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.785955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.804389] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: IN_PROGRESS for 2s [ 977.716189] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: SUCCESS [ 977.716438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.716980] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.717560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.717784] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.718093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.718093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.718215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.718299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.718436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.718602] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.721203] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe in Status: SUCCESS [ 977.721520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.722484] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 977.722742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.722960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.724240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.724390] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.724553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.724636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.724863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.724913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.725181] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.725832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.726070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.726259] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.726369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.726441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.726586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.726666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.726752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.726993] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.730052] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.730542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.730542] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.730542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.730758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.730758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.730861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.730890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.730964] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.732196] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.732426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.732527] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.732825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.732825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.732825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.732971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.732971] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.735024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.735024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.735125] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.737047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.737047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.737047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.737047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.737047] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.750712] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: SUCCESS [ 977.750897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.234103] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.234706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.234783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.235011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.235197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.235400] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.235585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.235627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.235869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.235975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.236106] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca is going to be updated. [ 978.242049] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.244419] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.244557] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.244943] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.245180] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.246758] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.246889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.246985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.247477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.247477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.247831] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.247831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.247831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.248416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.248416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.248416] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe is going to be deleted. [ 978.281086] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.281311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.281311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.281909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.281909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.284337] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.284526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.284596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.284790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.284900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.285056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.297596] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: IN_PROGRESS for 2s [ 978.402571] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 978.402571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.743956] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 575a9d53-3464-492c-a0bb-d9d7bb8b0eca: rpc.has_security_group_logging(os_id): False [ 978.751163] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.752040] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe: rpc.has_security_group_logging(os_id): False [ 978.765950] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.766238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.766238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.766551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.766676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.766958] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.767071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.767134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.767396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.767512] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.767620] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca is going to be updated. [ 978.771542] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.771663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.771704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.771898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.771977] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.772202] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.772301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.772384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.772538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.772631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.772721] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe is going to be created. [ 978.792864] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe], does not exist path=[/infra/domains/default/groups/80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe]."\n}' [ 978.793034] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe [ 978.793125] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 978.815118] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 978.815118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.815118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.815315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.815529] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.815652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.815718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.815869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.815953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.816103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.816150] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.841709] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.841709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.841709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.841709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.841709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.841918] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.841918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.842034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.842194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.842254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.842456] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.842557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.842619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.842773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.842852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.842939] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe is going to be created. [ 978.845756] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.845899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.845994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.846173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.846336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.871170] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: IN_PROGRESS for 2s [ 978.874578] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe], does not exist path=[/infra/domains/default/groups/80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe [ 978.874831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.875134] env[61538]: Traceback (most recent call last): [ 978.875190] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 978.875190] env[61538]: return func(*args, **kwargs) [ 978.875190] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 978.875190] env[61538]: res.raise_for_status() [ 978.875190] env[61538]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 978.875190] env[61538]: raise HTTPError(http_error_msg, response=self) [ 978.875190] env[61538]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe [ 978.875190] env[61538]: During handling of the above exception, another exception occurred: [ 978.875190] env[61538]: Traceback (most recent call last): [ 978.875694] env[61538]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 978.875694] env[61538]: listener.cb(fileno) [ 978.875694] env[61538]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 978.875694] env[61538]: result = function(*args, **kwargs) [ 978.875694] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 978.875694] env[61538]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 978.875694] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 978.875694] env[61538]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 978.875694] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 978.875694] env[61538]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 978.875694] env[61538]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 978.875694] env[61538]: res.raise_for_status() [ 978.875694] env[61538]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 978.875694] env[61538]: raise HTTPError(http_error_msg, response=self) [ 978.875694] env[61538]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/80e0d8e4-b842-4cc7-88d8-e6fcd5dc8bfe [ 978.875694] env[61538]: Removing descriptor: 23 [ 979.256562] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.256757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.256826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.257055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.257152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.257251] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 979.292580] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.292738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.292784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.293017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.293161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.307264] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 979.318779] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.318952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.319035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.319424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.319424] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.319579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.319623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.319762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.319852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.319938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.320102] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.320195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.320274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.320417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.320580] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.323959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.324124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.324319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.324417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.324528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.324677] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.831048] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bc3281e-af92-4997-a592-c0e030784b0d: rpc.has_security_group_logging(os_id): False [ 979.862081] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.862081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.862081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.862081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.901340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.901705] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.903192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.903192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.903192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.903192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.903405] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.903696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.903696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.903829] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.904031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.904388] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.904502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.904558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.904722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.904839] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.904903] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be updated. [ 979.988498] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.990774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.990774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.990774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.990774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.007073] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: IN_PROGRESS for 2s [ 980.103695] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 980.103910] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 980.309911] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: SUCCESS [ 980.310194] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca deletion is rescheduled due to dependency. [ 980.310421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.890733] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca in Status: SUCCESS [ 980.891038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.318366] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 981.318366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.318366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.318628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.319316] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.319316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.319316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.319316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.319569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.319569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.319750] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.319889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.319975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.320156] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.320348] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.320494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.320561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.320737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.320832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.320955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.321132] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.823374] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6798f697-f08e-4d7d-8b6e-6fb13201518f: rpc.has_security_group_logging(os_id): False [ 981.843825] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.844039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.844120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.844424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.872721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.873166] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.873374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.873486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.873687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.873835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.874080] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.874246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.874346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.874605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.874728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.874997] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.875149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.875258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.875495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.875623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.875753] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 981.993511] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.993848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.993848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.994059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.994110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.019619] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 982.021273] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 982.021559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.006332] env[61538]: INFO networking_nsxv3.common.synchronization [req-e4c8549e-bc58-4c6b-84fa-59bc188141f5 req-740f8096-ec94-4cf8-93ba-ed1d1ca1ba00 tempest-ListServerFiltersTestJSON-816069453 tempest-ListServerFiltersTestJSON-816069453-project-member] Enqueued Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 983.006939] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a with Priority: HIGHEST for action security_group_members [ 983.007310] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-563f2c80-ee39-48ef-8436-22a95e9bc54a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.007487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.007573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.007816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.008018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.008174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.008294] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.008419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.008573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.008634] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('563f2c80-ee39-48ef-8436-22a95e9bc54a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.511317] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.511483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.511483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.511955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.534302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.535280] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.535280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.535280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.535280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.535280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.535280] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a is going to be updated. [ 983.566763] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.566968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.567032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.567258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.567506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.577615] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: IN_PROGRESS for 2s [ 984.039331] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 984.039837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.594180] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a in Status: SUCCESS [ 985.594578] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 563f2c80-ee39-48ef-8436-22a95e9bc54a deletion is rescheduled due to dependency. [ 985.594578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-563f2c80-ee39-48ef-8436-22a95e9bc54a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.704694] env[61538]: INFO networking_nsxv3.common.synchronization [req-5794af99-0716-4a1b-8907-d79f59d6124c req-629bae58-d20c-47ab-9027-09a73763eaed tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 986.707018] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 986.707018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.707018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.707018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.707018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.707018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.707018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.707018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.707018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.707018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.707018] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.106524] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.106749] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.106862] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.107269] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.107629] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.107824] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.108044] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.108448] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.108604] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.108861] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.109031] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.109166] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.109298] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.109424] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.109737] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.109897] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.132010] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.132119] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 987.132275] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.132459] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.132794] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.132979] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.133123] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.133471] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.133626] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aacdaf9b-9518-4298-a1df-ce1c3931e8e2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.209444] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.209620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.209698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.209950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.210070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.210279] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.210384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.210472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.210658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.210740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.210827] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c already deleted. [ 987.210907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.635709] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.635986] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.636114] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.636415] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.636597] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.636761] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port aacdaf9b-9518-4298-a1df-ce1c3931e8e2 not found, creating... [ 987.637073] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.637248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.637424] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.637668] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.637813] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.638193] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.638389] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.638515] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.638742] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.638885] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.639045] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: aacdaf9b-9518-4298-a1df-ce1c3931e8e2 is going to be created. [ 987.661786] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.661990] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.662112] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.662417] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.662714] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.662963] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.423331] env[61538]: INFO networking_nsxv3.common.synchronization [req-5794af99-0716-4a1b-8907-d79f59d6124c req-21917096-18e4-43f0-b518-eb2eaa02c84e service nova] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_rules [ 988.423646] env[61538]: INFO networking_nsxv3.common.synchronization [req-5794af99-0716-4a1b-8907-d79f59d6124c req-21917096-18e4-43f0-b518-eb2eaa02c84e service nova] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 988.423697] env[61538]: INFO networking_nsxv3.common.synchronization [req-5794af99-0716-4a1b-8907-d79f59d6124c req-21917096-18e4-43f0-b518-eb2eaa02c84e service nova] Enqueued Resource ID: aacdaf9b-9518-4298-a1df-ce1c3931e8e2 with Priority: HIGHEST for action port [ 988.423916] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_rules [ 988.424075] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 988.424175] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aacdaf9b-9518-4298-a1df-ce1c3931e8e2 with Priority: HIGHEST for action port [ 988.425373] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.425373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.425373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.425623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.425623] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.426580] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.426580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.426698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.427688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.427688] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.427688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.427688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.427688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.427688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.427688] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.428195] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.428295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.428355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.428481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.428555] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aacdaf9b-9518-4298-a1df-ce1c3931e8e2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.930276] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.931631] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.931631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.931631] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aacdaf9b-9518-4298-a1df-ce1c3931e8e2 with status ACTIVE [ 988.931811] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.931924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.932061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.932245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.932401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.932573] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.932723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.932774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.932976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.933063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.933262] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.933401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.933973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.933973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.933973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.933973] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aacdaf9b-9518-4298-a1df-ce1c3931e8e2 is going to be updated. [ 988.958106] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.958106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.958106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.958106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.958106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.958106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aacdaf9b-9518-4298-a1df-ce1c3931e8e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.243795] env[61538]: INFO networking_nsxv3.common.synchronization [req-707cdeff-a2e2-48c2-b7ec-42506dee48bb req-afe3ed6f-8801-4bc9-b3e8-1708498496f2 tempest-ServerAddressesTestJSON-1186249743 tempest-ServerAddressesTestJSON-1186249743-project-member] Enqueued Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGHEST for action security_group_members [ 989.244565] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGHEST for action security_group_members [ 989.244924] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11dde3c4-ea2c-4769-852b-b7d0f666da42 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.246749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.246749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.246873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.246989] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.247136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.247195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.247381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.247485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.247586] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11dde3c4-ea2c-4769-852b-b7d0f666da42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.432701] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.750239] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.750420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.750544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.750888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.751047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.751261] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.751366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.751430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.751598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.751678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.751765] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 already deleted. [ 989.751846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.941501] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.941501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.941501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.941501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.941501] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.941501] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c is going to be created. [ 989.967038] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.967038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.967038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.967038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.967038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.981027] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: UNINITIALIZED for 2s [ 990.247024] env[61538]: INFO networking_nsxv3.common.synchronization [None req-eaa028ab-423b-4ff6-916f-5ee94ee93a2a tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_rules [ 990.247604] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_rules [ 990.247919] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a429894-62fb-4375-9201-aa412f677b75 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.250114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.250205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.250656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.250656] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.259487] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-799 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.259686] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-799" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.259837] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-799" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.263019] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-799" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.263019] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.263019] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.263019] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.263019] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.263019] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.263019] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.263019] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.263019] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.263019] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.263019] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.263019] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.263019] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.285444] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.285666] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.285757] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.285936] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-799" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.286332] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-039bac9c-919b-4727-8313-ea1206afb5ec taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.286539] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-039bac9c-919b-4727-8313-ea1206afb5ec" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.286694] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-039bac9c-919b-4727-8313-ea1206afb5ec" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.287073] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-039bac9c-919b-4727-8313-ea1206afb5ec" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.287225] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('039bac9c-919b-4727-8313-ea1206afb5ec',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.349145] env[61538]: INFO networking_nsxv3.common.synchronization [None req-616da794-e866-4026-88f7-e4ee04e91e1d tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_rules [ 990.349455] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_rules [ 990.349837] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a429894-62fb-4375-9201-aa412f677b75 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.349966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.781772] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.782138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.782138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.782422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.782728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.782728] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a429894-62fb-4375-9201-aa412f677b75 already deleted. [ 990.782728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.783473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.783775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.783878] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.790256] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.790663] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.790918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.791398] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.791687] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.791995] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 039bac9c-919b-4727-8313-ea1206afb5ec not found, creating... [ 990.792454] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.793049] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.793049] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.793220] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.793539] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.793899] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.794203] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.795601] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.795601] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.795601] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.795601] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 039bac9c-919b-4727-8313-ea1206afb5ec is going to be created. [ 990.828244] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.828565] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.828724] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.829909] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.829909] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.829909] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-039bac9c-919b-4727-8313-ea1206afb5ec" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.315581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.315850] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.315991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.316323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.316477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.316605] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a429894-62fb-4375-9201-aa412f677b75 already deleted. [ 991.316729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.994353] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: SUCCESS [ 991.994716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.994785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.995012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.995516] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.995640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.995710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.995888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.995977] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.996080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.996172] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.174910] env[61538]: INFO networking_nsxv3.common.synchronization [req-707cdeff-a2e2-48c2-b7ec-42506dee48bb req-bca9c2b8-48f2-4851-b551-0c55befcb9d3 service nova] Enqueued Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGHEST for action security_group_rules [ 992.174910] env[61538]: INFO networking_nsxv3.common.synchronization [req-707cdeff-a2e2-48c2-b7ec-42506dee48bb req-bca9c2b8-48f2-4851-b551-0c55befcb9d3 service nova] Enqueued Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGHEST for action security_group_members [ 992.175105] env[61538]: INFO networking_nsxv3.common.synchronization [req-707cdeff-a2e2-48c2-b7ec-42506dee48bb req-bca9c2b8-48f2-4851-b551-0c55befcb9d3 service nova] Enqueued Resource ID: 039bac9c-919b-4727-8313-ea1206afb5ec with Priority: HIGHEST for action port [ 992.177692] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGHEST for action security_group_rules [ 992.178496] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGHEST for action security_group_members [ 992.178496] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039bac9c-919b-4727-8313-ea1206afb5ec with Priority: HIGHEST for action port [ 992.178914] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11dde3c4-ea2c-4769-852b-b7d0f666da42 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.179345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.179560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.180522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.181134] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11dde3c4-ea2c-4769-852b-b7d0f666da42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.183293] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11dde3c4-ea2c-4769-852b-b7d0f666da42 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.183996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.184099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.184384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.184643] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.184804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.184900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.185152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.185348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.185748] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11dde3c4-ea2c-4769-852b-b7d0f666da42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.187485] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-039bac9c-919b-4727-8313-ea1206afb5ec taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.187834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-039bac9c-919b-4727-8313-ea1206afb5ec" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.187834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-039bac9c-919b-4727-8313-ea1206afb5ec" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.188217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-039bac9c-919b-4727-8313-ea1206afb5ec" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.188217] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('039bac9c-919b-4727-8313-ea1206afb5ec',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.499157] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.691205] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11dde3c4-ea2c-4769-852b-b7d0f666da42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.692703] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11dde3c4-ea2c-4769-852b-b7d0f666da42 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.692703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.693091] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 039bac9c-919b-4727-8313-ea1206afb5ec with status ACTIVE [ 992.693091] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.693091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.693091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.693301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.693960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.693960] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.693960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.693960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.695050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.695050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.695355] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.695721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.696046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.696366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.696617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.696852] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 039bac9c-919b-4727-8313-ea1206afb5ec is going to be updated. [ 992.755382] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.755382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.755382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.755696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.755821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.756220] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-039bac9c-919b-4727-8313-ea1206afb5ec" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.003226] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for febfb45e-9229-49aa-8dfc-5f90dbca1a4c: rpc.has_security_group_logging(os_id): False [ 993.024072] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.024072] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.024072] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.024286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.024460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.024858] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.025040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.026304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.026404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.029044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.029205] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c is going to be created. [ 993.125754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.125966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.125966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.126221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.126408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.146758] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: IN_PROGRESS for 2s [ 993.199932] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11dde3c4-ea2c-4769-852b-b7d0f666da42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.710280] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.710280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.710280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.710280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.710280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.710280] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 is going to be created. [ 993.745112] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.745297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.745297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.745504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.745663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.755087] env[61538]: INFO networking_nsxv3.common.synchronization [req-411c98cf-3457-4662-8e2d-f6f7b3ea3ef9 req-010a0c1c-0d0c-444f-93a4-ecb33f1b2531 tempest-ServersNegativeTestJSON-1742660343 tempest-ServersNegativeTestJSON-1742660343-project-member] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 993.758115] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 993.758371] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 in Status: UNINITIALIZED for 2s [ 993.758688] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.758813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.758882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.759124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.759280] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.759434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.759434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.759582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.759666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.759783] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.212538] env[61538]: INFO networking_nsxv3.common.synchronization [req-4fb25fb8-f143-4e5a-b681-04e3b64f1113 req-2949c135-04c0-4423-a283-5064cf140173 tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 994.213131] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 994.213442] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.215345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.215466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.215656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.215833] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.215940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.215996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.216163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.216249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.216345] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.261634] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.612705] env[61538]: INFO networking_nsxv3.common.synchronization [req-36739a5f-ecd6-4406-9091-da329d4c7a76 req-6e0d45d5-12d2-4ae7-befc-ffba68e4be0f tempest-MigrationsAdminTest-1836932771 tempest-MigrationsAdminTest-1836932771-project-member] Enqueued Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 994.613291] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580370e7-ea25-4027-912b-de772679071c with Priority: HIGHEST for action security_group_members [ 994.613613] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-580370e7-ea25-4027-912b-de772679071c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.613740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.613811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.614214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.614688] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.614840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.614912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.615132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.615209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.615273] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('580370e7-ea25-4027-912b-de772679071c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.719142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.719142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.719142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.719142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.742022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.742022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.742022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.742022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.742022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.742022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.742022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 994.751984] env[61538]: INFO networking_nsxv3.common.synchronization [req-f6b282cd-d64b-48ea-9eeb-f0aa4a64ca7f req-0684298a-94c3-493d-93b4-815aa968c3cd tempest-ServersTestBootFromVolume-2047470289 tempest-ServersTestBootFromVolume-2047470289-project-member] Enqueued Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_members [ 994.751984] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_members [ 994.751984] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-16598403-384b-4b7b-9e19-2f2d3b7596b6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.751984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.751984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.752922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.753112] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.753224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.753291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.753449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.753535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.753632] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.764650] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.769654] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.770680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.771119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.771346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.771621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.782299] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 995.118559] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.118687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.119487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.119487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.143372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.143990] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.143990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.143990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.144296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.144296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.144296] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 580370e7-ea25-4027-912b-de772679071c is going to be updated. [ 995.159703] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: SUCCESS [ 995.159984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.178563] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.178563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.178563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.178563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.178563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.187275] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: IN_PROGRESS for 2s [ 995.256169] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.256429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.256429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.256797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.256896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.257136] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.257240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.257303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.260049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.260049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.260049] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 already deleted. [ 995.260049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.267621] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.267798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.267877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.269347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.269347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.269347] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be updated. [ 995.315512] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-129 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.315889] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-129" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.316132] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-129" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.316563] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-129" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.318388] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.318388] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.318388] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.318388] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.318388] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.318388] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.318388] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.318388] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.318388] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.318388] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.318879] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.318879] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.324730] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.325084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.325166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.325504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.325742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.342885] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: IN_PROGRESS for 2s [ 995.349192] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.349580] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 995.349857] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.350136] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-129" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.350519] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-fab93887-61ce-41f0-a531-d540740b5acd taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.350755] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-fab93887-61ce-41f0-a531-d540740b5acd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.350994] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-fab93887-61ce-41f0-a531-d540740b5acd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.351496] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-fab93887-61ce-41f0-a531-d540740b5acd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.351704] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fab93887-61ce-41f0-a531-d540740b5acd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.770316] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 in Status: SUCCESS [ 995.770839] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.771165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.771485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.771779] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.772032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.772187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.772424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.772846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.773046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.773218] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11dde3c4-ea2c-4769-852b-b7d0f666da42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.854683] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.854967] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.855578] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.855653] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.855824] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.855998] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port fab93887-61ce-41f0-a531-d540740b5acd not found, creating... [ 995.856285] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.856447] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.856608] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.856833] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.856943] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.857334] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.857460] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.857579] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.857776] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.858088] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.858264] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: fab93887-61ce-41f0-a531-d540740b5acd is going to be created. [ 995.880351] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.880575] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.880778] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.881026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.881295] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.881495] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-fab93887-61ce-41f0-a531-d540740b5acd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.276282] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11dde3c4-ea2c-4769-852b-b7d0f666da42 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.276698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.276698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.276870] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.276870] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.277631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.277631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.277631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.277631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.277631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.277631] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11dde3c4-ea2c-4769-852b-b7d0f666da42 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.278164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.278164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.278164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.278164] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.278164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.278645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.278645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.278645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.278645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.278864] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11dde3c4-ea2c-4769-852b-b7d0f666da42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.782983] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11dde3c4-ea2c-4769-852b-b7d0f666da42: rpc.has_security_group_logging(os_id): False [ 996.799405] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 996.799405] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 996.799405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.806021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.806021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.806021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.806021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.806695] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.806695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.806695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.806695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.806695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.806695] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 is going to be created. [ 996.870667] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.870667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.870667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.870667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.870667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.878145] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 in Status: IN_PROGRESS for 2s [ 996.921282] env[61538]: INFO networking_nsxv3.common.synchronization [req-f6b282cd-d64b-48ea-9eeb-f0aa4a64ca7f req-82e8751f-7626-4ecd-a359-2e3ac0b49cbd service nova] Enqueued Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_rules [ 996.921282] env[61538]: INFO networking_nsxv3.common.synchronization [req-f6b282cd-d64b-48ea-9eeb-f0aa4a64ca7f req-82e8751f-7626-4ecd-a359-2e3ac0b49cbd service nova] Enqueued Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_members [ 996.921282] env[61538]: INFO networking_nsxv3.common.synchronization [req-f6b282cd-d64b-48ea-9eeb-f0aa4a64ca7f req-82e8751f-7626-4ecd-a359-2e3ac0b49cbd service nova] Enqueued Resource ID: fab93887-61ce-41f0-a531-d540740b5acd with Priority: HIGHEST for action port [ 996.921282] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_rules [ 996.921282] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_members [ 996.921282] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab93887-61ce-41f0-a531-d540740b5acd with Priority: HIGHEST for action port [ 996.921282] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16598403-384b-4b7b-9e19-2f2d3b7596b6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.921979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.922323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.922711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.923219] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.925566] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-16598403-384b-4b7b-9e19-2f2d3b7596b6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.926497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.926497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.926497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.926497] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.926497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.926746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.926746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.926807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.926986] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.927978] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-fab93887-61ce-41f0-a531-d540740b5acd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.928549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fab93887-61ce-41f0-a531-d540740b5acd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.928549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fab93887-61ce-41f0-a531-d540740b5acd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.928549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fab93887-61ce-41f0-a531-d540740b5acd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.928549] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fab93887-61ce-41f0-a531-d540740b5acd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.199723] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 580370e7-ea25-4027-912b-de772679071c in Status: SUCCESS [ 997.199723] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 580370e7-ea25-4027-912b-de772679071c deletion is rescheduled due to dependency. [ 997.199723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-580370e7-ea25-4027-912b-de772679071c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.356025] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 997.356025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.431047] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-16598403-384b-4b7b-9e19-2f2d3b7596b6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.431197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.431417] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.432373] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fab93887-61ce-41f0-a531-d540740b5acd with status ACTIVE [ 997.432567] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.432683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.432749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.432955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.433065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.433293] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.433435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.433515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.433675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.433754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.433939] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.434233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.434301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.434675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.434786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.434871] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fab93887-61ce-41f0-a531-d540740b5acd is going to be updated. [ 997.456708] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.456874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.456917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.457160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.457299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.457497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fab93887-61ce-41f0-a531-d540740b5acd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.937572] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.445026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.445026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.445026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.445026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.445026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.445026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 is going to be created. [ 998.475981] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.476165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.476248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.476469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.476626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.491854] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 in Status: UNINITIALIZED for 2s [ 998.897043] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 in Status: SUCCESS [ 998.897043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.020931] env[61538]: INFO networking_nsxv3.common.synchronization [req-9cd9a71d-9b0a-4ffe-be45-ab5f31963f20 req-546d2457-d322-4606-98ab-ded45e54f037 tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 999.021565] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 999.021941] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.022661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.022661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.022661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.022859] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.023153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.023153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.023249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.023590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.023590] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.529230] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.835927] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c6b3edf5-5f87-4699-a00b-7a47d51fae4f None None] Enqueued Resource ID: c5fd1049-e1ee-4327-b5c5-7d976af4ed5b with Priority: HIGHEST for action port [ 999.835927] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5fd1049-e1ee-4327-b5c5-7d976af4ed5b with Priority: HIGHEST for action port [ 999.835927] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5fd1049-e1ee-4327-b5c5-7d976af4ed5b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.835927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5fd1049-e1ee-4327-b5c5-7d976af4ed5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.835927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5fd1049-e1ee-4327-b5c5-7d976af4ed5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.835927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5fd1049-e1ee-4327-b5c5-7d976af4ed5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.835927] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5fd1049-e1ee-4327-b5c5-7d976af4ed5b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.031526] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.066478] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.066696] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.067022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.067130] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.067401] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.067678] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.067806] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.068151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.068368] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.068709] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.068888] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.069094] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.069218] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.069388] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.069529] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.069717] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.093157] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.093467] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1000.093643] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.093913] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.094370] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-ac373ca4-eda8-462a-a658-52fa15cb8b0b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.095194] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-ac373ca4-eda8-462a-a658-52fa15cb8b0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.095194] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-ac373ca4-eda8-462a-a658-52fa15cb8b0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.096450] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-ac373ca4-eda8-462a-a658-52fa15cb8b0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.096450] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac373ca4-eda8-462a-a658-52fa15cb8b0b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.339420] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5fd1049-e1ee-4327-b5c5-7d976af4ed5b [ 1000.339684] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.339858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.339936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.340120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.340244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.340367] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5fd1049-e1ee-4327-b5c5-7d976af4ed5b already deleted. [ 1000.340414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5fd1049-e1ee-4327-b5c5-7d976af4ed5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.505283] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 in Status: SUCCESS [ 1000.505603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.505789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.506307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.506307] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.506471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.506471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.506604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.506690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.506783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.506875] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.538612] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.538993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.538993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.539261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.539261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.539442] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 1000.578544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.578544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.578544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.578544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.578544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.593302] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 1000.599941] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.600277] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.600493] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.600810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.600993] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.601153] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port ac373ca4-eda8-462a-a658-52fa15cb8b0b not found, creating... [ 1000.601568] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.601788] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.601996] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.602681] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.602681] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.603422] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.603422] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.603422] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.603644] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.605339] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.605339] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: ac373ca4-eda8-462a-a658-52fa15cb8b0b is going to be created. [ 1000.631086] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.631283] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.631575] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.632284] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.632284] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.632919] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-ac373ca4-eda8-462a-a658-52fa15cb8b0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.015727] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.520212] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16598403-384b-4b7b-9e19-2f2d3b7596b6: rpc.has_security_group_logging(os_id): False [ 1001.544016] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.544561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.544561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.545127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.545273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.545838] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.545838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.546021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.546888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.546888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.547052] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 is going to be created. [ 1001.621653] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.621813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.621894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.622141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.622336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.643230] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 in Status: IN_PROGRESS for 2s [ 1002.111707] env[61538]: INFO networking_nsxv3.common.synchronization [req-9cd9a71d-9b0a-4ffe-be45-ab5f31963f20 req-8fc75955-e1e4-4f28-9d81-360344303ce1 service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 1002.111945] env[61538]: INFO networking_nsxv3.common.synchronization [req-9cd9a71d-9b0a-4ffe-be45-ab5f31963f20 req-8fc75955-e1e4-4f28-9d81-360344303ce1 service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1002.112164] env[61538]: INFO networking_nsxv3.common.synchronization [req-9cd9a71d-9b0a-4ffe-be45-ab5f31963f20 req-8fc75955-e1e4-4f28-9d81-360344303ce1 service nova] Enqueued Resource ID: ac373ca4-eda8-462a-a658-52fa15cb8b0b with Priority: HIGHEST for action port [ 1002.114166] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 1002.114166] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1002.114166] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac373ca4-eda8-462a-a658-52fa15cb8b0b with Priority: HIGHEST for action port [ 1002.114166] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.114166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.114166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.114166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.114166] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.115753] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.115753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.115950] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac373ca4-eda8-462a-a658-52fa15cb8b0b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.115950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac373ca4-eda8-462a-a658-52fa15cb8b0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.116057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac373ca4-eda8-462a-a658-52fa15cb8b0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.117184] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac373ca4-eda8-462a-a658-52fa15cb8b0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.117272] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac373ca4-eda8-462a-a658-52fa15cb8b0b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.276576] env[61538]: INFO networking_nsxv3.common.synchronization [req-55877c90-ce63-4126-a736-4d7bdbd0090a req-8dc0da9a-a303-4aa7-aac1-2f4916824afd tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_members [ 1002.277158] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_members [ 1002.277796] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a429894-62fb-4375-9201-aa412f677b75 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.278338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.278338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.279618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.279618] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.279618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.279618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.279872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.279872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.279987] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.571051] env[61538]: INFO networking_nsxv3.common.synchronization [req-f9bdec80-8df0-4462-846f-30b8f654a024 req-fb9bf3e3-c884-45f8-ac41-99fd94b43a81 tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_members [ 1002.571700] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGHEST for action security_group_members [ 1002.572411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4854c6da-988b-40cb-9c61-b312f09d4a28 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.576200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.576200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.576200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.576200] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.576200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.576200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.576200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.576200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.576200] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.609798] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 1002.610042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.610585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.610817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.611032] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.611156] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.611225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.611407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.611514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.611612] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.619395] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.619545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.622128] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac373ca4-eda8-462a-a658-52fa15cb8b0b with status ACTIVE [ 1002.622548] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.622678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.622739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.622992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.623104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.623330] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.623455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.623547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.623737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.623827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.624061] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.624248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.624248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.624446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.624513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.624615] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac373ca4-eda8-462a-a658-52fa15cb8b0b is going to be updated. [ 1002.650621] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.651612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.651760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.652255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.652255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.652404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac373ca4-eda8-462a-a658-52fa15cb8b0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.685603] env[61538]: INFO networking_nsxv3.common.synchronization [None req-cdb7569a-5277-4fc8-9a07-e225f914c6c1 None None] Enqueued Resource ID: 780d5d6e-7363-498a-a9f6-6cc433891b84 with Priority: HIGHEST for action port [ 1002.686906] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 780d5d6e-7363-498a-a9f6-6cc433891b84 with Priority: HIGHEST for action port [ 1002.687648] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-780d5d6e-7363-498a-a9f6-6cc433891b84 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.689874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-780d5d6e-7363-498a-a9f6-6cc433891b84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.689874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-780d5d6e-7363-498a-a9f6-6cc433891b84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.689874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-780d5d6e-7363-498a-a9f6-6cc433891b84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.689874] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('780d5d6e-7363-498a-a9f6-6cc433891b84',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.783654] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.783905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.784045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.784373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.784524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.784869] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.785044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.785172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.785518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.785653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.785795] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a429894-62fb-4375-9201-aa412f677b75 already deleted. [ 1002.785940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.078756] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.079152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.079325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.079722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.115014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.115450] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.115612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.115707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.116264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.116264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.116264] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 is going to be updated. [ 1003.118300] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.163998] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.164306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.164470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.164813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.166112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.178249] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 in Status: IN_PROGRESS for 2s [ 1003.191345] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 780d5d6e-7363-498a-a9f6-6cc433891b84 [ 1003.191678] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.191832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.191906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.192177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.192283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.192398] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:780d5d6e-7363-498a-a9f6-6cc433891b84 already deleted. [ 1003.192485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-780d5d6e-7363-498a-a9f6-6cc433891b84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.622035] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.667194] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 in Status: SUCCESS [ 1003.667695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.677016] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.678029] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.678029] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.678029] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.678180] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.678325] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.678434] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.678790] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.679740] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.679740] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.679740] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.679740] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.679740] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.679740] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.679991] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.679991] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.706775] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.706966] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1003.707270] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.707356] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.707812] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-7e18e278-e525-407c-90fa-107184503c1c taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.708061] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-7e18e278-e525-407c-90fa-107184503c1c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.708223] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-7e18e278-e525-407c-90fa-107184503c1c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.708603] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-7e18e278-e525-407c-90fa-107184503c1c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.708828] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e18e278-e525-407c-90fa-107184503c1c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.127600] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.127753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.127892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.128138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.128578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.128759] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 1004.159167] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.159330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.159405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.159642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.159792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.168622] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 1004.212388] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.212750] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.212951] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.213366] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.213611] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.213837] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 7e18e278-e525-407c-90fa-107184503c1c not found, creating... [ 1004.214300] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.214838] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.214838] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.214950] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.215672] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.215672] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.215858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.215858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.216512] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.216512] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.216512] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 7e18e278-e525-407c-90fa-107184503c1c is going to be created. [ 1004.240265] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.240522] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.240664] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.240979] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.241257] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.241575] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-7e18e278-e525-407c-90fa-107184503c1c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.188446] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 in Status: SUCCESS [ 1005.188816] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 deletion is rescheduled due to dependency. [ 1005.188816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.284865] env[61538]: INFO networking_nsxv3.common.synchronization [req-96a0796e-0620-4e57-94ea-e558bb43dd79 req-6ff4c621-b35c-45c4-950d-45b57489c16b tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 1005.285057] env[61538]: INFO networking_nsxv3.common.synchronization [req-96a0796e-0620-4e57-94ea-e558bb43dd79 req-6ff4c621-b35c-45c4-950d-45b57489c16b tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 1005.285232] env[61538]: INFO networking_nsxv3.common.synchronization [req-96a0796e-0620-4e57-94ea-e558bb43dd79 req-6ff4c621-b35c-45c4-950d-45b57489c16b tempest-SecurityGroupsTestJSON-958481474 tempest-SecurityGroupsTestJSON-958481474-project-member] Enqueued Resource ID: 65ce3e97-db41-488c-9988-1959f1dc1965 with Priority: HIGHEST for action security_group_members [ 1005.285761] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGHEST for action security_group_members [ 1005.285906] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f with Priority: HIGHEST for action security_group_members [ 1005.286010] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ce3e97-db41-488c-9988-1959f1dc1965 with Priority: HIGHEST for action security_group_members [ 1005.286532] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.286664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.286733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.286940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.287125] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.287246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.287308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.287532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.287666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.287808] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.292020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6798f697-f08e-4d7d-8b6e-6fb13201518f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.292020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.292020] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6798f697-f08e-4d7d-8b6e-6fb13201518f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.292020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ce3e97-db41-488c-9988-1959f1dc1965 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.292020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.292020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.292968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.292968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.292968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.292968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.292968] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65ce3e97-db41-488c-9988-1959f1dc1965',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.498563] env[61538]: INFO networking_nsxv3.common.synchronization [req-55877c90-ce63-4126-a736-4d7bdbd0090a req-85827ddf-32a9-42b2-8989-4e5ebcca6c34 service nova] Enqueued Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_rules [ 1005.498656] env[61538]: INFO networking_nsxv3.common.synchronization [req-55877c90-ce63-4126-a736-4d7bdbd0090a req-85827ddf-32a9-42b2-8989-4e5ebcca6c34 service nova] Enqueued Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_members [ 1005.498773] env[61538]: INFO networking_nsxv3.common.synchronization [req-55877c90-ce63-4126-a736-4d7bdbd0090a req-85827ddf-32a9-42b2-8989-4e5ebcca6c34 service nova] Enqueued Resource ID: 7e18e278-e525-407c-90fa-107184503c1c with Priority: HIGHEST for action port [ 1005.499033] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_rules [ 1005.499166] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_members [ 1005.499261] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e18e278-e525-407c-90fa-107184503c1c with Priority: HIGHEST for action port [ 1005.499820] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a429894-62fb-4375-9201-aa412f677b75 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.499945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.500512] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.501515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.501515] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.501980] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a429894-62fb-4375-9201-aa412f677b75 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.502267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.502267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.503101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.503101] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.503101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.503101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.503282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.503313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.507023] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.507023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e18e278-e525-407c-90fa-107184503c1c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.507023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e18e278-e525-407c-90fa-107184503c1c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.507023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e18e278-e525-407c-90fa-107184503c1c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.507023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e18e278-e525-407c-90fa-107184503c1c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.507023] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e18e278-e525-407c-90fa-107184503c1c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.795275] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.795275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.795275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.795275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.795275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.795275] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.795275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.795275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.795275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.795275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.795275] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f is going to be updated. [ 1005.795275] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.795841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.795841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.795841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.796631] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.796728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.821212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.821399] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.821579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.821662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.821902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.821996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.822131] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 is going to be updated. [ 1005.823435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.823640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.837247] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.837379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.837447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.837722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.837863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.844555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.844824] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.844945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.845023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.845225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.845312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.845418] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65ce3e97-db41-488c-9988-1959f1dc1965 is going to be updated. [ 1005.852787] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: IN_PROGRESS for 2s [ 1005.855463] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.855463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.855463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.855463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.855738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.871437] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: IN_PROGRESS for 2s [ 1005.887482] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.887714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.887804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.888050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.888219] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.900958] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ce3e97-db41-488c-9988-1959f1dc1965 in Status: IN_PROGRESS for 2s [ 1006.009395] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a429894-62fb-4375-9201-aa412f677b75 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.009395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.010733] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.012327] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e18e278-e525-407c-90fa-107184503c1c with status ACTIVE [ 1006.013395] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.014269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.014353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.015039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.015039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.015150] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.015437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.015617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.015891] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.016050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.016276] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.016410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.016521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.016789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.016887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.016984] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e18e278-e525-407c-90fa-107184503c1c is going to be updated. [ 1006.045100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.045287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.045327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.045571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.045698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.045860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e18e278-e525-407c-90fa-107184503c1c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.180561] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 1006.180900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.181232] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.181487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.181819] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.182044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.182130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.182312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.182403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.182494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.182589] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.521646] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.685475] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.685730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.686288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.686288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.686288] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.686494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.686494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.686635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.686754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.686953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.687304] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.687304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.687304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.687879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.687879] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.687879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.687879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.688135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.688135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.689398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.689515] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.027661] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.027884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.027940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.031021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.031021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.031021] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a429894-62fb-4375-9201-aa412f677b75 is going to be created. [ 1007.066407] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.066588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.066656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.066887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.067481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.090771] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a429894-62fb-4375-9201-aa412f677b75 in Status: UNINITIALIZED for 2s [ 1007.195311] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b: rpc.has_security_group_logging(os_id): False [ 1007.227253] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.227253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.227730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.227730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.263497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.264067] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.264067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.264067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.264318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.264432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.264556] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.264657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.264718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.264867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.264952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.265236] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.265355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.265417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.265567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.265645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.265734] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 1007.358447] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.358662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.358746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.358972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.359237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.381623] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 1007.866607] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f in Status: SUCCESS [ 1007.866607] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6798f697-f08e-4d7d-8b6e-6fb13201518f deletion is rescheduled due to dependency. [ 1007.866607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6798f697-f08e-4d7d-8b6e-6fb13201518f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.882105] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 in Status: SUCCESS [ 1007.882320] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 deletion is rescheduled due to dependency. [ 1007.882425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.912787] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ce3e97-db41-488c-9988-1959f1dc1965 in Status: SUCCESS [ 1007.913041] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65ce3e97-db41-488c-9988-1959f1dc1965 deletion is rescheduled due to dependency. [ 1007.913178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ce3e97-db41-488c-9988-1959f1dc1965" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.918028] env[61538]: INFO networking_nsxv3.common.synchronization [req-d171ac7b-e44f-45c3-a4d1-983d266ac146 req-6bc7f81a-435c-44fb-b8de-de7d99617ab7 tempest-ImagesOneServerNegativeTestJSON-513524542 tempest-ImagesOneServerNegativeTestJSON-513524542-project-member] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1008.918335] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1008.918687] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.918815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.918865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.919203] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.919387] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.920182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.920182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.920182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.920182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.920182] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.018283] env[61538]: INFO networking_nsxv3.common.synchronization [None req-866fa634-d631-484f-925f-f18c229d5453 None None] Enqueued Resource ID: 91e19d7a-046c-43cb-8f9a-80f896294461 with Priority: HIGHEST for action port [ 1009.018283] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e19d7a-046c-43cb-8f9a-80f896294461 with Priority: HIGHEST for action port [ 1009.018283] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-91e19d7a-046c-43cb-8f9a-80f896294461 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.018283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91e19d7a-046c-43cb-8f9a-80f896294461" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.018283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91e19d7a-046c-43cb-8f9a-80f896294461" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.018962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91e19d7a-046c-43cb-8f9a-80f896294461" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.019151] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91e19d7a-046c-43cb-8f9a-80f896294461',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.102663] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a429894-62fb-4375-9201-aa412f677b75 in Status: SUCCESS [ 1009.103187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.104227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.104517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.104884] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.105451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.105784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.106035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.106284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.106713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.106947] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.398975] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 1009.398975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.424439] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.424654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.424809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.425062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.452422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.452749] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.452899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.452899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.453148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.453267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.453330] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be updated. [ 1009.489356] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.489553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.489619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.489932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.490197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.506125] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: IN_PROGRESS for 2s [ 1009.521576] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91e19d7a-046c-43cb-8f9a-80f896294461 [ 1009.522268] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.522347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.522471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.522772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.522866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.522964] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91e19d7a-046c-43cb-8f9a-80f896294461 already deleted. [ 1009.523055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91e19d7a-046c-43cb-8f9a-80f896294461" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.610401] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.114995] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a429894-62fb-4375-9201-aa412f677b75: rpc.has_security_group_logging(os_id): False [ 1010.139327] env[61538]: INFO networking_nsxv3.common.synchronization [req-9373ebb0-c149-42eb-b01d-a18e50d048e6 req-e29dd185-7ca3-40f6-a903-348a1e524451 tempest-ServerAddressesTestJSON-1186249743 tempest-ServerAddressesTestJSON-1186249743-project-member] Enqueued Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGHEST for action security_group_members [ 1010.141244] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.141414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.141457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.141865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.141994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.142277] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.142404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.142474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.142602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.143366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.143495] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a429894-62fb-4375-9201-aa412f677b75 is going to be created. [ 1010.144945] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGHEST for action security_group_members [ 1010.145906] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11dde3c4-ea2c-4769-852b-b7d0f666da42 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.146029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.147041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.147041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.147041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.147041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.147041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.147041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.147317] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.147317] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11dde3c4-ea2c-4769-852b-b7d0f666da42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.233872] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.233872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.233872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.233872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.233872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.247785] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a429894-62fb-4375-9201-aa412f677b75 in Status: IN_PROGRESS for 2s [ 1010.653125] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.653498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.653498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.654128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.654128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.654367] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.654509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.654608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.654938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.654938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.655559] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 is going to be updated. [ 1010.693092] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.693092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.693092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.693773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.693773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.705035] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 in Status: IN_PROGRESS for 2s [ 1010.893426] env[61538]: INFO networking_nsxv3.common.synchronization [None req-2b643d98-ddb1-4e25-9691-0ebcb505cd60 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_rules [ 1010.893758] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_rules [ 1010.894818] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.897323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.897431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.898034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.898034] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.135694] env[61538]: INFO networking_nsxv3.common.synchronization [None req-dd74f4a9-5117-4858-8f82-27d17b7af632 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_rules [ 1011.136532] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_rules [ 1011.136865] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.137058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.191206] env[61538]: INFO networking_nsxv3.common.synchronization [None req-d9355945-7c48-4d21-a5cf-09700f907ec3 None None] Enqueued Resource ID: 98195a94-adfb-4342-a0ab-672483c01356 with Priority: HIGHEST for action port [ 1011.191505] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98195a94-adfb-4342-a0ab-672483c01356 with Priority: HIGHEST for action port [ 1011.192315] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-98195a94-adfb-4342-a0ab-672483c01356 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.192421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98195a94-adfb-4342-a0ab-672483c01356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.192421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98195a94-adfb-4342-a0ab-672483c01356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.192655] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98195a94-adfb-4342-a0ab-672483c01356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.192830] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98195a94-adfb-4342-a0ab-672483c01356',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.423533] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.423533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.423533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.423533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.423533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.423533] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 already deleted. [ 1011.423533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.423533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.423533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.423533] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.520806] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 1011.521033] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c deletion is rescheduled due to dependency. [ 1011.521145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.694487] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98195a94-adfb-4342-a0ab-672483c01356 [ 1011.694779] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.694960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.695063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.695419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.695486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.695573] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98195a94-adfb-4342-a0ab-672483c01356 already deleted. [ 1011.695670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98195a94-adfb-4342-a0ab-672483c01356" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.950063] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.950063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.950063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.950063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.950063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.950063] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 already deleted. [ 1011.950063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.262560] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a429894-62fb-4375-9201-aa412f677b75 in Status: SUCCESS [ 1012.262907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.418391] env[61538]: INFO networking_nsxv3.common.synchronization [req-a19db587-5482-4247-9c81-80b0e00a9143 req-43b9041a-a3c4-46d8-965c-7f021fe024c4 tempest-ServersWithSpecificFlavorTestJSON-1598309329 tempest-ServersWithSpecificFlavorTestJSON-1598309329-project-member] Enqueued Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 1012.418948] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e with Priority: HIGHEST for action security_group_members [ 1012.419291] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.419420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.419575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.419687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.419838] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.419929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.419985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.420350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.420442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.420543] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('463a8c39-ee54-4fb8-a9f5-3967b4233a2e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.715888] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 in Status: SUCCESS [ 1012.716091] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 deletion is rescheduled due to dependency. [ 1012.716336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.741731] env[61538]: INFO networking_nsxv3.common.synchronization [req-0e7de878-1341-4c5b-9f97-72f669e44b2d req-cdd4df25-579c-4578-ba49-5d099c812ace tempest-ImagesOneServerTestJSON-1832733047 tempest-ImagesOneServerTestJSON-1832733047-project-member] Enqueued Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGHEST for action security_group_members [ 1012.742325] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGHEST for action security_group_members [ 1012.742647] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-40127aa2-e264-47ea-9c74-2c16d7be1c98 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.742772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.742839] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.743123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.743281] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.743385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.743447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.743600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.743701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.743794] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40127aa2-e264-47ea-9c74-2c16d7be1c98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.923792] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.923978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.924072] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.924309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.949321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.950686] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.950686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.950686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.950686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.950686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.950686] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e is going to be updated. [ 1012.987298] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.987466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.987604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.987875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.988056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.999617] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: IN_PROGRESS for 2s [ 1013.245971] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.246173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.246173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.246367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.246463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.246682] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.246784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.246844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.246993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.247084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.247172] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 already deleted. [ 1013.247254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.535727] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.535727] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-237" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.535727] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-237" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.535727] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-237" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.535727] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.535727] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.535727] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.536605] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.536605] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.536605] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.536605] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.536777] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.536777] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.536848] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.538586] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.538586] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.559448] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.559629] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.559780] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.559976] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-237" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.561674] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-c9965f3c-2499-49d5-ba57-a093571cfc9e taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.561674] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-c9965f3c-2499-49d5-ba57-a093571cfc9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.561674] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-c9965f3c-2499-49d5-ba57-a093571cfc9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.561674] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-c9965f3c-2499-49d5-ba57-a093571cfc9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.561674] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9965f3c-2499-49d5-ba57-a093571cfc9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.066050] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.066050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.066050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.066050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.066050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.066050] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port c9965f3c-2499-49d5-ba57-a093571cfc9e not found, creating... [ 1014.066050] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.066050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.066050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.066050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.066050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.066853] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.066853] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.066853] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.066853] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.067447] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.067783] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: c9965f3c-2499-49d5-ba57-a093571cfc9e is going to be created. [ 1014.097187] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.097187] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.097187] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.097187] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.097187] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.097187] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-c9965f3c-2499-49d5-ba57-a093571cfc9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.013223] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e in Status: SUCCESS [ 1015.013498] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 463a8c39-ee54-4fb8-a9f5-3967b4233a2e deletion is rescheduled due to dependency. [ 1015.013498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-463a8c39-ee54-4fb8-a9f5-3967b4233a2e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.281043] env[61538]: INFO networking_nsxv3.common.synchronization [req-0e7de878-1341-4c5b-9f97-72f669e44b2d req-ac4091c0-782a-44b9-abf6-87341eafdb99 service nova] Enqueued Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGHEST for action security_group_rules [ 1015.281043] env[61538]: INFO networking_nsxv3.common.synchronization [req-0e7de878-1341-4c5b-9f97-72f669e44b2d req-ac4091c0-782a-44b9-abf6-87341eafdb99 service nova] Enqueued Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGHEST for action security_group_members [ 1015.281043] env[61538]: INFO networking_nsxv3.common.synchronization [req-0e7de878-1341-4c5b-9f97-72f669e44b2d req-ac4091c0-782a-44b9-abf6-87341eafdb99 service nova] Enqueued Resource ID: c9965f3c-2499-49d5-ba57-a093571cfc9e with Priority: HIGHEST for action port [ 1015.281043] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGHEST for action security_group_rules [ 1015.284978] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGHEST for action security_group_members [ 1015.284978] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9965f3c-2499-49d5-ba57-a093571cfc9e with Priority: HIGHEST for action port [ 1015.284978] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40127aa2-e264-47ea-9c74-2c16d7be1c98 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.284978] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40127aa2-e264-47ea-9c74-2c16d7be1c98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.284978] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-40127aa2-e264-47ea-9c74-2c16d7be1c98 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.284978] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.284978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.284978] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40127aa2-e264-47ea-9c74-2c16d7be1c98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.285780] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9965f3c-2499-49d5-ba57-a093571cfc9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.286373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9965f3c-2499-49d5-ba57-a093571cfc9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.286373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9965f3c-2499-49d5-ba57-a093571cfc9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.286373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9965f3c-2499-49d5-ba57-a093571cfc9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.286373] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9965f3c-2499-49d5-ba57-a093571cfc9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.784939] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-40127aa2-e264-47ea-9c74-2c16d7be1c98 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.784939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.789735] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40127aa2-e264-47ea-9c74-2c16d7be1c98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.791449] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9965f3c-2499-49d5-ba57-a093571cfc9e with status ACTIVE [ 1015.791748] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.791928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.792059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.792380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.792507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.792789] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.792943] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.796458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.797359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.797359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.797359] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.797359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.797359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.797784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.798168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.798537] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9965f3c-2499-49d5-ba57-a093571cfc9e is going to be updated. [ 1015.821708] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.821867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.821936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.822240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.822381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.822557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9965f3c-2499-49d5-ba57-a093571cfc9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.300162] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40127aa2-e264-47ea-9c74-2c16d7be1c98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.806948] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.806948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.806948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.806948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.806948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.806948] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 is going to be created. [ 1016.843280] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.843280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.843280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.843280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.843570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.861413] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 in Status: UNINITIALIZED for 2s [ 1018.239942] env[61538]: INFO networking_nsxv3.common.synchronization [req-2b83887f-f276-46bc-ab24-6e332c1328e7 req-c200131e-e996-46e8-91cf-746992a525b9 tempest-ServersAdminTestJSON-1231961305 tempest-ServersAdminTestJSON-1231961305-project-member] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 1018.240863] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 1018.240964] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.244583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.244583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.244583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.244583] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.244583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.244583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.244583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.244583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.244583] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.749425] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.874618] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 in Status: SUCCESS [ 1018.875037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.875294] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.875590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.875873] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.876078] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.876192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.876423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.876551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.876691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.876838] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40127aa2-e264-47ea-9c74-2c16d7be1c98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.251420] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.379493] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-40127aa2-e264-47ea-9c74-2c16d7be1c98 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.379783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.379783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.380022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.380209] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.380319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.380386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.380562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.380655] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.380748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.381017] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-40127aa2-e264-47ea-9c74-2c16d7be1c98 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.381307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.381398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.381561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.381733] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.381836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.381895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.382270] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.382384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.382490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.382616] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40127aa2-e264-47ea-9c74-2c16d7be1c98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.755282] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.755529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.755680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.756395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.756395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.756395] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 1019.791250] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.791429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.791561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.791755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.791930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.804872] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 1019.885397] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40127aa2-e264-47ea-9c74-2c16d7be1c98: rpc.has_security_group_logging(os_id): False [ 1019.911236] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.911409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.911448] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.912086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.912251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.912498] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.912611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.912680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.912903] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.912989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.917694] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.917868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.917938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.918282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.918373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.918654] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.918813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.918882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.919080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.919176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.919272] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 is going to be created. [ 1019.999829] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.000037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.000181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.000561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.000931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.016492] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 in Status: IN_PROGRESS for 2s [ 1021.227712] env[61538]: INFO networking_nsxv3.common.synchronization [None req-604ed4ae-43d8-4b54-8452-cc4155f83567 tempest-ImagesOneServerNegativeTestJSON-513524542 tempest-ImagesOneServerNegativeTestJSON-513524542-project-member] Enqueued Resource ID: f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a with Priority: HIGHEST for action security_group_rules [ 1021.233024] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a with Priority: HIGHEST for action security_group_rules [ 1021.233024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.233024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.233024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.233024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.233024] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.316488] env[61538]: INFO networking_nsxv3.common.synchronization [None req-aff753f7-57e1-4d7d-8abc-5f105c5ae62d tempest-ImagesOneServerNegativeTestJSON-513524542 tempest-ImagesOneServerNegativeTestJSON-513524542-project-member] Enqueued Resource ID: f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a with Priority: HIGHEST for action security_group_rules [ 1021.316488] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a with Priority: HIGHEST for action security_group_rules [ 1021.316488] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.316488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.756912] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.756912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.756912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.756912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.756912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.756912] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a already deleted. [ 1021.756912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.756912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.756912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.756912] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.825947] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 1021.826222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.034222] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 in Status: SUCCESS [ 1022.034463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.280737] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.281218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.281218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.281218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.281702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.281702] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a already deleted. [ 1022.281702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f09235a3-aaab-4bb4-83fd-8df2d9d9fa4a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.558446] env[61538]: INFO networking_nsxv3.common.synchronization [req-1fcf6f83-04ae-43d9-b851-798833d2ca22 req-e6126ae1-100d-495d-9ffb-643522b78119 tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1022.558446] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1022.558446] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.558446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.558446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.559050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.559050] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.559205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.559301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.559468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.559556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.559653] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.064161] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.570865] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.072524] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.078189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.078189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.078189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.078189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.078189] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 1024.105820] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.106021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.106183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.106324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.106494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.118059] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 1026.131133] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 1026.131497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.233847] env[61538]: INFO networking_nsxv3.common.synchronization [None req-3a7a2db9-381e-4668-a7c9-8512331bf292 None None] Enqueued Resource ID: e08abb1a-b5c8-42b1-89d9-05bd30181c64 with Priority: HIGHEST for action port [ 1027.236794] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e08abb1a-b5c8-42b1-89d9-05bd30181c64 with Priority: HIGHEST for action port [ 1027.236794] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e08abb1a-b5c8-42b1-89d9-05bd30181c64 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.236794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e08abb1a-b5c8-42b1-89d9-05bd30181c64" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.236794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e08abb1a-b5c8-42b1-89d9-05bd30181c64" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.236794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e08abb1a-b5c8-42b1-89d9-05bd30181c64" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.236794] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e08abb1a-b5c8-42b1-89d9-05bd30181c64',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.741169] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e08abb1a-b5c8-42b1-89d9-05bd30181c64 [ 1027.741169] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.741169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.741169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.741169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.741169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.741169] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e08abb1a-b5c8-42b1-89d9-05bd30181c64 already deleted. [ 1027.741169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e08abb1a-b5c8-42b1-89d9-05bd30181c64" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.065388] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c009a81f-7346-44c0-9624-39d975f44b87 tempest-ServersTestJSON-1123416272 tempest-ServersTestJSON-1123416272-project-member] Enqueued Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_rules [ 1028.065987] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_rules [ 1028.066413] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.066413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.066594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.066748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.066855] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.232229] env[61538]: INFO networking_nsxv3.common.synchronization [None req-326c0a14-2547-4c3d-9116-db70a43c0188 tempest-ServersTestJSON-1123416272 tempest-ServersTestJSON-1123416272-project-member] Enqueued Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_rules [ 1028.232229] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_rules [ 1028.232229] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.232229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.597891] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.598406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.598545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.598919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.599030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.599077] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f59fc458-059e-4374-b3e2-7acaf6e64082 already deleted. [ 1028.599164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.599327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.599482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.599565] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.125333] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.125333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.125333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.125333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.125333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.125333] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f59fc458-059e-4374-b3e2-7acaf6e64082 already deleted. [ 1029.125333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.369927] env[61538]: INFO networking_nsxv3.common.synchronization [req-f00a929a-5f4e-4258-b417-a950d848c08a req-5ce26688-681f-455c-b5b9-22ce3910ce49 tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1029.370945] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1029.376338] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.376338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.376338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.376338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.376626] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.376626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.376626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.376736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.376843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.376843] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.882411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.882740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.882740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.882985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.883137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.883445] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.883544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.883544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.883686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.883765] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.883854] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1029.903362] env[61538]: INFO networking_nsxv3.common.synchronization [None req-495c2623-3c40-4746-948c-bb6cebed01f4 None None] Enqueued Resource ID: 3e4a2901-bb5d-4646-99c8-f378747c04b6 with Priority: HIGHEST for action port [ 1029.903968] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4a2901-bb5d-4646-99c8-f378747c04b6 with Priority: HIGHEST for action port [ 1029.904329] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e4a2901-bb5d-4646-99c8-f378747c04b6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.904474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e4a2901-bb5d-4646-99c8-f378747c04b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.904552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e4a2901-bb5d-4646-99c8-f378747c04b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.905160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e4a2901-bb5d-4646-99c8-f378747c04b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.905160] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e4a2901-bb5d-4646-99c8-f378747c04b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.914993] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.915492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.915848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.916359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.916434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.930536] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1030.409258] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e4a2901-bb5d-4646-99c8-f378747c04b6 [ 1030.409503] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.409641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.409709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.409926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.410031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.410146] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e4a2901-bb5d-4646-99c8-f378747c04b6 already deleted. [ 1030.410239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e4a2901-bb5d-4646-99c8-f378747c04b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.812704] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.813022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.813147] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.813461] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.813779] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.813978] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.818025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.818025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.818025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.818025] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.818025] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.818025] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.818025] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.818025] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.818025] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.818025] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.842287] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.842514] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1030.842597] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.842793] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.843163] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.843358] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.843463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.844420] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.844651] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b10a96e-6545-4419-9cd0-afa5ce3e2cc2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.353028] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.353028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.353028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.353028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.353028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.353028] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 6b10a96e-6545-4419-9cd0-afa5ce3e2cc2 not found, creating... [ 1031.353028] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.353028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.353028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.353028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.353028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.353750] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.353750] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.353750] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.354414] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.354738] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.355043] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 6b10a96e-6545-4419-9cd0-afa5ce3e2cc2 is going to be created. [ 1031.386026] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.386026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.386026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.386026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.386026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.386026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.610875] env[61538]: INFO networking_nsxv3.common.synchronization [req-0e489aa8-50d1-4a7a-94b3-3aaad9d03058 req-2d212cfa-2aae-4b4b-9ac4-6ff4a7a0f116 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_members [ 1031.611534] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_members [ 1031.611860] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8835-25b4-4cc2-a332-a16e5b92a588 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.612993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.613291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.613465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.615024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.615024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.615024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.615024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.615024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.615024] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.943106] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1031.943242] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 1031.943363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.120973] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.121187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.121353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.121441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.121535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.121741] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.121844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.121915] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.122045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.122123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.122211] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 already deleted. [ 1032.122292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.569067] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.569067] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.569067] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.569067] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.570077] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.570425] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.570665] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.571686] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.574018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.574018] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.574018] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.574018] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.574018] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.574018] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.574018] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.574018] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.596531] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.597579] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.597579] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.597579] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.597579] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.597579] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.597884] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.598141] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.598234] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce640f58-ba75-4bd9-8c39-40145ff6ac4e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.621026] env[61538]: INFO networking_nsxv3.common.synchronization [req-f00a929a-5f4e-4258-b417-a950d848c08a req-050c56ee-d1ef-4ec3-83c5-76ec74462541 service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 1032.621026] env[61538]: INFO networking_nsxv3.common.synchronization [req-f00a929a-5f4e-4258-b417-a950d848c08a req-050c56ee-d1ef-4ec3-83c5-76ec74462541 service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1032.621026] env[61538]: INFO networking_nsxv3.common.synchronization [req-f00a929a-5f4e-4258-b417-a950d848c08a req-050c56ee-d1ef-4ec3-83c5-76ec74462541 service nova] Enqueued Resource ID: 6b10a96e-6545-4419-9cd0-afa5ce3e2cc2 with Priority: HIGHEST for action port [ 1032.621026] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 1032.621251] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1032.621251] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b10a96e-6545-4419-9cd0-afa5ce3e2cc2 with Priority: HIGHEST for action port [ 1032.621791] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.621917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.621976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.624130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.624223] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.625403] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.625403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.625403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.625624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.625624] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.625761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.625761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.625865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.626396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.626396] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.628278] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.628535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.628535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.628656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.628720] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b10a96e-6545-4419-9cd0-afa5ce3e2cc2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.103456] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.103707] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.103838] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.104187] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.104392] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.104588] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port ce640f58-ba75-4bd9-8c39-40145ff6ac4e not found, creating... [ 1033.108021] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.108021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.108021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.108021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.108021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.108021] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.108021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.108021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.108735] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.108950] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.108992] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: ce640f58-ba75-4bd9-8c39-40145ff6ac4e is going to be created. [ 1033.130668] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.130828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.131076] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.132023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b10a96e-6545-4419-9cd0-afa5ce3e2cc2 with status ACTIVE [ 1033.132271] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.132466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.132466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.132980] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.132980] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.132980] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.132980] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.133273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.133273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.133273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.133449] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.133541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.133632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.133781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.133851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.133937] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b10a96e-6545-4419-9cd0-afa5ce3e2cc2 is going to be updated. [ 1033.159293] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.159634] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.159761] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.159992] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.160285] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.160596] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.172668] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.172935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.172935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.173113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.173368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.173452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b10a96e-6545-4419-9cd0-afa5ce3e2cc2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.638237] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.142558] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.142700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.142802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.143068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.143155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.143383] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1034.175581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.175768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.175822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.176052] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.176194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.185719] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1034.671779] env[61538]: INFO networking_nsxv3.common.synchronization [req-0e489aa8-50d1-4a7a-94b3-3aaad9d03058 req-bfab60fe-387a-4ee3-8535-8f8ba13be20e service nova] Enqueued Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_rules [ 1034.672150] env[61538]: INFO networking_nsxv3.common.synchronization [req-0e489aa8-50d1-4a7a-94b3-3aaad9d03058 req-bfab60fe-387a-4ee3-8535-8f8ba13be20e service nova] Enqueued Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_members [ 1034.672216] env[61538]: INFO networking_nsxv3.common.synchronization [req-0e489aa8-50d1-4a7a-94b3-3aaad9d03058 req-bfab60fe-387a-4ee3-8535-8f8ba13be20e service nova] Enqueued Resource ID: ce640f58-ba75-4bd9-8c39-40145ff6ac4e with Priority: HIGHEST for action port [ 1034.672737] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_rules [ 1034.672894] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_members [ 1034.675768] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce640f58-ba75-4bd9-8c39-40145ff6ac4e with Priority: HIGHEST for action port [ 1034.676464] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.676639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.676735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.676989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.677125] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.678283] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8835-25b4-4cc2-a332-a16e5b92a588 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.678801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.679073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.679272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.679980] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.680119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.680182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.680352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.680472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.680742] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.681716] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.681846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.681925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.682107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.682188] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce640f58-ba75-4bd9-8c39-40145ff6ac4e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.184686] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.186649] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8835-25b4-4cc2-a332-a16e5b92a588 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.187303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.187582] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce640f58-ba75-4bd9-8c39-40145ff6ac4e with status ACTIVE [ 1035.187873] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.188823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.188823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.188823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.189257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.189486] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.189648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.189700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.189880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.189970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.190201] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.190318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.190386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.190541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.190622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.190712] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce640f58-ba75-4bd9-8c39-40145ff6ac4e is going to be updated. [ 1035.217690] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.217881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.217925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.218156] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.218319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.218496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce640f58-ba75-4bd9-8c39-40145ff6ac4e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.687676] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.192692] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.192692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.192692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.192692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.192692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.192692] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 is going to be created. [ 1036.198464] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1036.198464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.198464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.198464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.198464] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.198464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.198464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.198464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.198464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.198464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.198464] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.219282] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.219282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.219282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.219282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.219282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.230135] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 in Status: UNINITIALIZED for 2s [ 1036.703023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.703023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.703023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.703023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.703946] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.703946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.703946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.703946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.703946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.703946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.703946] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.207669] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fcbd20b-13e3-44c4-bf9a-746a1da000dc: rpc.has_security_group_logging(os_id): False [ 1037.230403] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.230815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.230815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.230974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.231066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.231441] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.231571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.231636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.231828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.232020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.232362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.232493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.232555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.232729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.232809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.233073] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.233883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.233883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.233883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.233883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.233883] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1037.326489] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.326736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.326736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.326931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.327139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.349384] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1038.242249] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 in Status: SUCCESS [ 1038.242609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.243268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.243268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.243268] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.243498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.243498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.244545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.244545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.244545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.244545] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.747649] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.255050] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e3d8835-25b4-4cc2-a332-a16e5b92a588: rpc.has_security_group_logging(os_id): False [ 1039.276334] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.276757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.276757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.276865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.277121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.277266] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.277379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.277498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.277696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.277857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.277955] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 is going to be created. [ 1039.342120] env[61538]: INFO networking_nsxv3.common.synchronization [req-2a80214f-7f0c-4f4d-8c9f-735a77b60cff req-d3f4ccee-9633-41d2-9e50-4d34a6129fe5 tempest-ServersAdminTestJSON-1231961305 tempest-ServersAdminTestJSON-1231961305-project-member] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 1039.343898] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.343898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.343898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.343898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.343898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.345272] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 1039.345601] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.345717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.345848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.345960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.346115] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.346203] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.346259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.346399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.346512] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.346607] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.358240] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 in Status: IN_PROGRESS for 2s [ 1039.369254] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1039.369254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.849376] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.352483] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.451732] env[61538]: INFO networking_nsxv3.common.synchronization [req-1dd47ce4-2932-41cf-bcc7-fe319fff821a req-35ae668b-4f5d-4546-a9e3-013b99d6200f tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1040.452499] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1040.452908] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.453120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.453232] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.453437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.453584] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.453693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.453755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.453944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.453998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.454100] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.677919] env[61538]: INFO networking_nsxv3.common.synchronization [req-d20b7f5f-bc92-4013-954e-7d5d3f41151a req-61d7b36d-ee43-40eb-ba8f-bb196c3a7f59 tempest-ImagesOneServerNegativeTestJSON-513524542 tempest-ImagesOneServerNegativeTestJSON-513524542-project-member] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1040.678938] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1040.678938] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.679874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.679874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.679874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.680631] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.680631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.680631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.680631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.680631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.680631] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.859196] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.859455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.859566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.859886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.860040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.860198] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 1040.892830] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.892981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.893066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.893664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.893664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.905172] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 1040.956904] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.957112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.957219] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.957543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.957692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.958025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.958176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.958275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.958524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.958664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.958805] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 1041.001553] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.001739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.001815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.002095] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.002263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.017096] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 1041.185791] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.185791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.185791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.185791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.185791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.185791] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.185791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.185791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.185791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.185791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.185791] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be updated. [ 1041.213212] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.213398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.213465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.213632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.213775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.225891] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: IN_PROGRESS for 2s [ 1041.353429] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.353429] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.353429] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.353429] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.353429] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.353429] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.353429] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.353429] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.353429] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.353429] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.354318] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.354447] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.354505] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.354595] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.354714] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.356384] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.373619] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 in Status: SUCCESS [ 1041.373757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.378517] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.378517] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.378653] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.378801] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.379125] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-b8a4b8ef-6552-4028-a715-5b4022737ea0 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.379720] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-b8a4b8ef-6552-4028-a715-5b4022737ea0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.379720] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-b8a4b8ef-6552-4028-a715-5b4022737ea0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.379886] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-b8a4b8ef-6552-4028-a715-5b4022737ea0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.379937] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8a4b8ef-6552-4028-a715-5b4022737ea0',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.718666] env[61538]: INFO networking_nsxv3.common.synchronization [None req-a5f4c527-aeb2-4751-8303-140d63483681 None None] Enqueued Resource ID: 38d0a537-ac95-4c52-80a3-5368b20931d7 with Priority: HIGHEST for action port [ 1041.719110] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d0a537-ac95-4c52-80a3-5368b20931d7 with Priority: HIGHEST for action port [ 1041.719428] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-38d0a537-ac95-4c52-80a3-5368b20931d7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.720190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38d0a537-ac95-4c52-80a3-5368b20931d7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.720281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38d0a537-ac95-4c52-80a3-5368b20931d7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.720537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38d0a537-ac95-4c52-80a3-5368b20931d7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.720627] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38d0a537-ac95-4c52-80a3-5368b20931d7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.883472] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.883752] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.883931] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.884365] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.885473] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.885473] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port b8a4b8ef-6552-4028-a715-5b4022737ea0 not found, creating... [ 1041.885473] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.885473] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.885691] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.886075] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.889704] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.891733] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.892162] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.892539] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.892738] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.892953] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.893175] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: b8a4b8ef-6552-4028-a715-5b4022737ea0 is going to be created. [ 1041.919896] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.919896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.919896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.919896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.919896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.919896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-b8a4b8ef-6552-4028-a715-5b4022737ea0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.229454] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38d0a537-ac95-4c52-80a3-5368b20931d7 [ 1042.229732] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.229881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.229954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.230281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.230379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.230490] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38d0a537-ac95-4c52-80a3-5368b20931d7 already deleted. [ 1042.230596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38d0a537-ac95-4c52-80a3-5368b20931d7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.917794] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 1042.918328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.947294] env[61538]: INFO networking_nsxv3.common.synchronization [req-d20b7f5f-bc92-4013-954e-7d5d3f41151a req-d0462268-6f3f-4e9d-ba16-a8b411bb931c service nova] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_rules [ 1042.947484] env[61538]: INFO networking_nsxv3.common.synchronization [req-d20b7f5f-bc92-4013-954e-7d5d3f41151a req-d0462268-6f3f-4e9d-ba16-a8b411bb931c service nova] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1042.947633] env[61538]: INFO networking_nsxv3.common.synchronization [req-d20b7f5f-bc92-4013-954e-7d5d3f41151a req-d0462268-6f3f-4e9d-ba16-a8b411bb931c service nova] Enqueued Resource ID: b8a4b8ef-6552-4028-a715-5b4022737ea0 with Priority: HIGHEST for action port [ 1042.948181] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_rules [ 1042.948909] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1042.948909] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a4b8ef-6552-4028-a715-5b4022737ea0 with Priority: HIGHEST for action port [ 1042.948909] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.948909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.949124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.953924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.953924] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.953924] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.953924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.953924] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8a4b8ef-6552-4028-a715-5b4022737ea0 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.953924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8a4b8ef-6552-4028-a715-5b4022737ea0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.953924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8a4b8ef-6552-4028-a715-5b4022737ea0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.953924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8a4b8ef-6552-4028-a715-5b4022737ea0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.953924] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8a4b8ef-6552-4028-a715-5b4022737ea0',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.028759] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 1043.028759] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b deletion is rescheduled due to dependency. [ 1043.028759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.244934] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 1043.245193] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c deletion is rescheduled due to dependency. [ 1043.245338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.245560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.245846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.246117] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.246285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.246384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.246571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.246671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.247164] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.455266] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.455266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.459382] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8a4b8ef-6552-4028-a715-5b4022737ea0 with status ACTIVE [ 1043.459382] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.459382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.459382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.459382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.459382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.459641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.459696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.459732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.460277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.460277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.460277] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.460437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.460437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.460539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.460616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.460755] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8a4b8ef-6552-4028-a715-5b4022737ea0 is going to be updated. [ 1043.499934] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.499934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.499934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.499934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.499934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.499934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8a4b8ef-6552-4028-a715-5b4022737ea0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.751607] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.253982] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.496063] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1a4b6621-55f2-4b83-8799-0efe29bd85da None None] Enqueued Resource ID: 5f648dcd-ce16-41ad-a68e-afa3c0f75109 with Priority: HIGHEST for action port [ 1044.496625] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f648dcd-ce16-41ad-a68e-afa3c0f75109 with Priority: HIGHEST for action port [ 1044.496971] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f648dcd-ce16-41ad-a68e-afa3c0f75109 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.497094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f648dcd-ce16-41ad-a68e-afa3c0f75109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.497180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f648dcd-ce16-41ad-a68e-afa3c0f75109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.497453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f648dcd-ce16-41ad-a68e-afa3c0f75109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.497539] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f648dcd-ce16-41ad-a68e-afa3c0f75109',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.756536] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.756848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.756848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.756952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.757058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.757164] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be updated. [ 1044.794351] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.794478] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.794556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.794777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.794928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.808652] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: IN_PROGRESS for 2s [ 1044.999852] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f648dcd-ce16-41ad-a68e-afa3c0f75109 [ 1045.000207] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.001133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.001212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.001505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.004690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.004690] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f648dcd-ce16-41ad-a68e-afa3c0f75109 already deleted. [ 1045.004690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f648dcd-ce16-41ad-a68e-afa3c0f75109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.494482] env[61538]: INFO networking_nsxv3.common.synchronization [req-64146504-703f-462a-932d-577d6507810c req-53fd3e8a-a6b9-4746-906b-bc5bdb47c3f9 tempest-ServersTestJSON-1123416272 tempest-ServersTestJSON-1123416272-project-member] Enqueued Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_members [ 1046.498130] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_members [ 1046.498130] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.498130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.498130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.498130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.498130] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.498130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.498130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.498130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.498130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.498130] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.820495] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 1046.821177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.821283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.821474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.821659] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.821778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.821838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.822267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.822267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.822267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.822267] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.999879] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.000096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.000144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.000400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.000495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.000694] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.000797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.000862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.001080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.001178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.001268] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59fc458-059e-4374-b3e2-7acaf6e64082 already deleted. [ 1047.001365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.324815] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.325053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.325107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.325304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.325513] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.325720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.325773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.326059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.326253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.326375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.326715] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.327039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.327162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.327357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.327535] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.327688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.327795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.328507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.328648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.328789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.328931] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.491444] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.491601] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-606" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.491644] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-606" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.491974] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-606" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.492265] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.492445] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.492575] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.492807] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.492964] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.493472] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.493602] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.493719] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.493837] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.493961] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.494080] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.494217] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.515342] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.515621] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1047.515672] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.515894] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-606" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.516266] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-5f4a8e1e-aa1b-4785-8467-54496ef2257b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.516475] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-5f4a8e1e-aa1b-4785-8467-54496ef2257b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.516567] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-5f4a8e1e-aa1b-4785-8467-54496ef2257b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.516880] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-5f4a8e1e-aa1b-4785-8467-54496ef2257b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.517031] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f4a8e1e-aa1b-4785-8467-54496ef2257b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.831618] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11ca0972-f93e-4e78-b9f2-0d09798b331c: rpc.has_security_group_logging(os_id): False [ 1047.851894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.851894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.851894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.851894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.853425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.853425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.854972] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.854972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.854972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.854972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.854972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.855237] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be updated. [ 1047.919497] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.919665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.919718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.919941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.920106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.934450] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: IN_PROGRESS for 2s [ 1048.020026] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.020321] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.020496] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.020795] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.020960] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.021165] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 5f4a8e1e-aa1b-4785-8467-54496ef2257b not found, creating... [ 1048.021454] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.021625] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.021750] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.021981] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.022162] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.022442] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.022603] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.022727] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.022955] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.023567] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.023799] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 5f4a8e1e-aa1b-4785-8467-54496ef2257b is going to be created. [ 1048.058644] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.059250] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.059250] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.059250] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.060394] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.060394] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-5f4a8e1e-aa1b-4785-8467-54496ef2257b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.166679] env[61538]: INFO networking_nsxv3.common.synchronization [req-64146504-703f-462a-932d-577d6507810c req-89c0521d-b79e-471b-9105-01f62296b700 service nova] Enqueued Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_rules [ 1049.167112] env[61538]: INFO networking_nsxv3.common.synchronization [req-64146504-703f-462a-932d-577d6507810c req-89c0521d-b79e-471b-9105-01f62296b700 service nova] Enqueued Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_members [ 1049.167112] env[61538]: INFO networking_nsxv3.common.synchronization [req-64146504-703f-462a-932d-577d6507810c req-89c0521d-b79e-471b-9105-01f62296b700 service nova] Enqueued Resource ID: 5f4a8e1e-aa1b-4785-8467-54496ef2257b with Priority: HIGHEST for action port [ 1049.167334] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_rules [ 1049.167477] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_members [ 1049.167569] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f4a8e1e-aa1b-4785-8467-54496ef2257b with Priority: HIGHEST for action port [ 1049.168297] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.168297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.168449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.168558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.168661] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.169559] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.169670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.169729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.169914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.172506] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.172506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.172506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.172506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.172506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.172506] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.172506] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f4a8e1e-aa1b-4785-8467-54496ef2257b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.172506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f4a8e1e-aa1b-4785-8467-54496ef2257b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.172506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f4a8e1e-aa1b-4785-8467-54496ef2257b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.172506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f4a8e1e-aa1b-4785-8467-54496ef2257b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.172506] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f4a8e1e-aa1b-4785-8467-54496ef2257b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.675210] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.675210] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.675210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.675498] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f4a8e1e-aa1b-4785-8467-54496ef2257b with status ACTIVE [ 1049.675570] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.675673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.675733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.675941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.676204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.676289] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.677217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.677217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.677217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.677217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.677217] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.677217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.682106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.686489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.686489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.686636] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f4a8e1e-aa1b-4785-8467-54496ef2257b is going to be updated. [ 1049.714399] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.714601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.714673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.714898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.715062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.715266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f4a8e1e-aa1b-4785-8467-54496ef2257b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.953477] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 1049.953718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.189769] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.692593] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.692852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.692928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.693259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.693391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.693529] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59fc458-059e-4374-b3e2-7acaf6e64082 is going to be created. [ 1050.722669] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.722887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.722887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.723147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.723453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.735276] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59fc458-059e-4374-b3e2-7acaf6e64082 in Status: UNINITIALIZED for 2s [ 1052.749718] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59fc458-059e-4374-b3e2-7acaf6e64082 in Status: SUCCESS [ 1052.750467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.755419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.755419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.755419] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.755419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.755419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.755419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.755419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.755898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.755898] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.257822] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.476991] env[61538]: INFO networking_nsxv3.common.synchronization [req-5df2ad2e-46a2-4067-9dfe-0b3554a64dfe req-f2231db5-7285-49a0-88ad-20a1d4b99fd9 tempest-ServersTestBootFromVolume-2047470289 tempest-ServersTestBootFromVolume-2047470289-project-member] Enqueued Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_members [ 1053.477535] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGHEST for action security_group_members [ 1053.477855] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-16598403-384b-4b7b-9e19-2f2d3b7596b6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.477975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.478097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.478307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.478471] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.478570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.478634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.478938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.478938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.479055] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.763333] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f59fc458-059e-4374-b3e2-7acaf6e64082: rpc.has_security_group_logging(os_id): False [ 1053.788508] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.791018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.791018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.791018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.791018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.791018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.791018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.791018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.791018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.791018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.791018] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f59fc458-059e-4374-b3e2-7acaf6e64082 is going to be created. [ 1053.858529] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.858529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.858529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.858529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.858529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.873604] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59fc458-059e-4374-b3e2-7acaf6e64082 in Status: IN_PROGRESS for 2s [ 1053.982566] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.982764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.983204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.983471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.984955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.986214] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.986433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.986790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.987998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.988195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.988256] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 is going to be updated. [ 1054.021895] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.021895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.021895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.021895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.021895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.036289] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 in Status: IN_PROGRESS for 2s [ 1055.294666] env[61538]: INFO networking_nsxv3.common.synchronization [req-5e0aafa4-0b65-438f-ac22-bf8e5aa45459 req-e037f957-120e-4113-b89e-6c6da87aaa32 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1055.295240] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1055.295808] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.295955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.296028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.300766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.300766] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.300766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.300766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.300766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.300766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.300766] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.585165] env[61538]: INFO networking_nsxv3.common.synchronization [None req-7f349d92-9038-49a9-a95a-174178e50868 None None] Enqueued Resource ID: e3467ce4-6ac6-416a-8a04-6203cf44ae5a with Priority: HIGHEST for action port [ 1055.585740] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3467ce4-6ac6-416a-8a04-6203cf44ae5a with Priority: HIGHEST for action port [ 1055.587025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3467ce4-6ac6-416a-8a04-6203cf44ae5a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.587025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3467ce4-6ac6-416a-8a04-6203cf44ae5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.587025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3467ce4-6ac6-416a-8a04-6203cf44ae5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.587025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3467ce4-6ac6-416a-8a04-6203cf44ae5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.587025] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3467ce4-6ac6-416a-8a04-6203cf44ae5a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.805628] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.805628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.805628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.805628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.805628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.805628] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.805628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.805628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.805628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.805628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.805628] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb already deleted. [ 1055.805628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.887315] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59fc458-059e-4374-b3e2-7acaf6e64082 in Status: SUCCESS [ 1055.887315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.913718] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.913718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.913718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.913718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.913718] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.913718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.913718] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.914302] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.914585] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.914908] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.915227] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.915431] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.915635] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.916184] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.916465] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.916804] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.939770] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.940398] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1055.942017] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.942017] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.942017] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-5a70c23b-fb28-4302-add1-42b019c5c4f7 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.942017] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-5a70c23b-fb28-4302-add1-42b019c5c4f7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.942017] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-5a70c23b-fb28-4302-add1-42b019c5c4f7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.943553] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-5a70c23b-fb28-4302-add1-42b019c5c4f7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.944022] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a70c23b-fb28-4302-add1-42b019c5c4f7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.052184] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 in Status: SUCCESS [ 1056.052184] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 deletion is rescheduled due to dependency. [ 1056.052184] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.089802] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3467ce4-6ac6-416a-8a04-6203cf44ae5a [ 1056.090193] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.090454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.090454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.090686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.090826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.090942] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3467ce4-6ac6-416a-8a04-6203cf44ae5a already deleted. [ 1056.091081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3467ce4-6ac6-416a-8a04-6203cf44ae5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.449876] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.450215] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.450278] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.450578] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.450775] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.450949] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 5a70c23b-fb28-4302-add1-42b019c5c4f7 not found, creating... [ 1056.452789] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.452905] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.453076] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.453363] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.453524] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.456227] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.456227] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.456227] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.456227] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.456227] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.456718] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 5a70c23b-fb28-4302-add1-42b019c5c4f7 is going to be created. [ 1056.485630] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.485886] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.486048] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.486370] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.487017] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.487017] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-5a70c23b-fb28-4302-add1-42b019c5c4f7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.290715] env[61538]: INFO networking_nsxv3.common.synchronization [req-5e0aafa4-0b65-438f-ac22-bf8e5aa45459 req-0a43e553-8358-4de9-9224-7acb4bc477b5 service nova] Enqueued Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_rules [ 1058.290715] env[61538]: INFO networking_nsxv3.common.synchronization [req-5e0aafa4-0b65-438f-ac22-bf8e5aa45459 req-0a43e553-8358-4de9-9224-7acb4bc477b5 service nova] Enqueued Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1058.290715] env[61538]: INFO networking_nsxv3.common.synchronization [req-5e0aafa4-0b65-438f-ac22-bf8e5aa45459 req-0a43e553-8358-4de9-9224-7acb4bc477b5 service nova] Enqueued Resource ID: 5a70c23b-fb28-4302-add1-42b019c5c4f7 with Priority: HIGHEST for action port [ 1058.291109] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_rules [ 1058.291109] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1058.291109] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a70c23b-fb28-4302-add1-42b019c5c4f7 with Priority: HIGHEST for action port [ 1058.291616] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.291952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.291952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.292081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.292157] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.293085] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.293194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.293567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.293567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.293701] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.293701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.293812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.294661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.294661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.294661] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.294860] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a70c23b-fb28-4302-add1-42b019c5c4f7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.299407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a70c23b-fb28-4302-add1-42b019c5c4f7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.299407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a70c23b-fb28-4302-add1-42b019c5c4f7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.299407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a70c23b-fb28-4302-add1-42b019c5c4f7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.299407] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a70c23b-fb28-4302-add1-42b019c5c4f7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.362415] env[61538]: INFO networking_nsxv3.common.synchronization [None req-b95d76f4-6631-415e-ae42-9bf2ef7d8c1e None None] Enqueued Resource ID: 3dc249f3-e6c3-4cf0-bad2-c368a232d785 with Priority: HIGHEST for action port [ 1058.362415] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc249f3-e6c3-4cf0-bad2-c368a232d785 with Priority: HIGHEST for action port [ 1058.362538] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dc249f3-e6c3-4cf0-bad2-c368a232d785 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.362684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dc249f3-e6c3-4cf0-bad2-c368a232d785" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.362774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dc249f3-e6c3-4cf0-bad2-c368a232d785" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.363658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dc249f3-e6c3-4cf0-bad2-c368a232d785" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.363745] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc249f3-e6c3-4cf0-bad2-c368a232d785',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.800100] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.801187] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.801323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.801461] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a70c23b-fb28-4302-add1-42b019c5c4f7 with status ACTIVE [ 1058.801615] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.801755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.801822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.802048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.802137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.802304] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.802395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.803628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.803628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.803628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.803628] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.803628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.808117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.808117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.808117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.808117] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a70c23b-fb28-4302-add1-42b019c5c4f7 is going to be updated. [ 1058.837593] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.838257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.838257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.838257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.838497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.838670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a70c23b-fb28-4302-add1-42b019c5c4f7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.866731] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dc249f3-e6c3-4cf0-bad2-c368a232d785 [ 1058.866994] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.867233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.867373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.867558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.867657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.867792] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dc249f3-e6c3-4cf0-bad2-c368a232d785 already deleted. [ 1058.867908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dc249f3-e6c3-4cf0-bad2-c368a232d785" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.314445] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.673112] env[61538]: INFO networking_nsxv3.common.synchronization [req-01a93ec0-9ada-4dd7-8866-2dbe2aa5eee5 req-9e8df1b4-d5dd-46f8-a869-dbe5cee42a82 tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_members [ 1059.677026] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a429894-62fb-4375-9201-aa412f677b75 with Priority: HIGHEST for action security_group_members [ 1059.677026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a429894-62fb-4375-9201-aa412f677b75 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.677026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.677026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.677026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.677026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.677026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.677026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.677026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.677026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.677026] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a429894-62fb-4375-9201-aa412f677b75',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.819047] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.819544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.825760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.825760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.825760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.825760] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb is going to be created. [ 1059.869880] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.870047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.870121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.870343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.870527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.883961] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: UNINITIALIZED for 2s [ 1060.148593] env[61538]: INFO networking_nsxv3.common.synchronization [req-e68c523f-c363-4a21-86d0-41d49cfbcbc6 req-aeae3e61-f38b-4400-89ec-c8e3409dfad1 tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1060.151444] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1060.155664] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.155892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.155989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.156585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.157525] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.157525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.157525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.157525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.157525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.157851] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.181134] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.181134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.181377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.181453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.181547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.181787] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.181887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.181942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.182117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.182191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.182270] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a429894-62fb-4375-9201-aa412f677b75 is going to be updated. [ 1060.221393] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.221561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.221663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.221841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.221998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.233323] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a429894-62fb-4375-9201-aa412f677b75 in Status: IN_PROGRESS for 2s [ 1060.664716] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.664716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.664716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.664716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.664716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.664716] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.664716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.664716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.664716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.664716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.664716] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 1060.694434] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.694677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.694677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.695040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.695551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.708413] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 1061.182832] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.183048] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.183212] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.183480] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.183753] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.183943] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.184071] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.184301] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.184460] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.184739] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.184863] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.184980] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.185106] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.185222] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.185333] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.185473] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.207013] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.207211] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1061.207368] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.207547] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-317" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.207889] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-56c23893-2f0c-48e2-ad52-6dcdf0869d98 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.208072] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-56c23893-2f0c-48e2-ad52-6dcdf0869d98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.208206] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-56c23893-2f0c-48e2-ad52-6dcdf0869d98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.208587] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-56c23893-2f0c-48e2-ad52-6dcdf0869d98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.208737] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c23893-2f0c-48e2-ad52-6dcdf0869d98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.713438] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.714061] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.714061] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.714538] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.714609] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.714743] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 56c23893-2f0c-48e2-ad52-6dcdf0869d98 not found, creating... [ 1061.715050] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.715226] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.715356] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.715594] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.715740] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.716230] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.716392] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.716648] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.717044] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.717309] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.717595] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 56c23893-2f0c-48e2-ad52-6dcdf0869d98 is going to be created. [ 1061.743818] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.744194] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.744416] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.744784] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.746123] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.746446] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-56c23893-2f0c-48e2-ad52-6dcdf0869d98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.897285] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: SUCCESS [ 1061.897684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.897830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.898113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.898415] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.898619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.898619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.898792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.898866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.898959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.899088] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.248563] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a429894-62fb-4375-9201-aa412f677b75 in Status: SUCCESS [ 1062.248563] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a429894-62fb-4375-9201-aa412f677b75 deletion is rescheduled due to dependency. [ 1062.248563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a429894-62fb-4375-9201-aa412f677b75" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.402405] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.402953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.402953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.403166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.403277] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.403401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.403484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.403630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.403821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.403821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.403971] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.404050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.405110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.405110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.405110] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.405110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.405110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.405110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.405110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.405110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.405110] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.721851] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 1062.722531] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b deletion is rescheduled due to dependency. [ 1062.722531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.909584] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d15333c-499a-45ad-a20b-dad70f7f90bb: rpc.has_security_group_logging(os_id): False [ 1062.932605] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.932973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.933185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.933542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.933660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.933907] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.935630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.935630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.935793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.935867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.936186] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.936435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.936523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.936769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.936861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.937113] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.937346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.937346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.937440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.937803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.937803] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb is going to be created. [ 1063.008396] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.008480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.008585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.008842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.009107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.021769] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: IN_PROGRESS for 2s [ 1063.040059] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.040388] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.040536] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.040844] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.041150] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.041347] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.041482] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.041712] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.041863] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.042129] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.042353] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.042551] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.042733] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.042866] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.042982] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.043150] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.065593] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.065855] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.066109] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.066446] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.066929] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-7e7e6bd8-fac2-4516-af29-a249216acca6 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.067206] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.067346] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.067659] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.067800] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e7e6bd8-fac2-4516-af29-a249216acca6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.570040] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.570356] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.570592] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.571016] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.571185] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.571436] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.571616] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.571788] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.572080] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.572642] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.572642] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.573128] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.573128] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.573426] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.573549] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.573800] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 7e7e6bd8-fac2-4516-af29-a249216acca6 is going to be updated. [ 1063.594880] env[61538]: INFO networking_nsxv3.common.synchronization [req-e68c523f-c363-4a21-86d0-41d49cfbcbc6 req-04f44bed-d30a-4124-b338-cf92262f00b6 service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 1063.595081] env[61538]: INFO networking_nsxv3.common.synchronization [req-e68c523f-c363-4a21-86d0-41d49cfbcbc6 req-04f44bed-d30a-4124-b338-cf92262f00b6 service nova] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1063.595495] env[61538]: INFO networking_nsxv3.common.synchronization [req-e68c523f-c363-4a21-86d0-41d49cfbcbc6 req-04f44bed-d30a-4124-b338-cf92262f00b6 service nova] Enqueued Resource ID: 56c23893-2f0c-48e2-ad52-6dcdf0869d98 with Priority: HIGHEST for action port [ 1063.595815] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_rules [ 1063.595956] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1063.596423] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c23893-2f0c-48e2-ad52-6dcdf0869d98 with Priority: HIGHEST for action port [ 1063.598459] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.598459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.598459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.598459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.598459] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.598459] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.598459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.598459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.598964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.598964] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.598964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.598964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.599198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.599198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.599826] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.600605] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-56c23893-2f0c-48e2-ad52-6dcdf0869d98 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.600726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56c23893-2f0c-48e2-ad52-6dcdf0869d98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.600798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56c23893-2f0c-48e2-ad52-6dcdf0869d98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.600972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56c23893-2f0c-48e2-ad52-6dcdf0869d98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.601064] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c23893-2f0c-48e2-ad52-6dcdf0869d98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.603307] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.603452] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.603452] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.603687] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.603894] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.604145] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.744411] env[61538]: INFO networking_nsxv3.common.synchronization [req-e591780f-f19d-42b1-9646-2a2e04c335ea req-a16e721a-259b-4b56-a8a9-ade955d23bb5 tempest-ServersAdminTestJSON-1231961305 tempest-ServersAdminTestJSON-1231961305-project-member] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 1063.745820] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 1063.746399] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.746550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.746550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.747526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.747526] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.747526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.747526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.747526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.747526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.747526] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.103450] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.103663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.103840] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.109323] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56c23893-2f0c-48e2-ad52-6dcdf0869d98 with status ACTIVE [ 1064.110180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.110492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.110685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.111590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.111734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.111957] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.112267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.112349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.112646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.112750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.113314] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.113585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.113585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.113704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.113704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.113806] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56c23893-2f0c-48e2-ad52-6dcdf0869d98 is going to be updated. [ 1064.147647] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.147822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.147884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.148156] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.148423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.151394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56c23893-2f0c-48e2-ad52-6dcdf0869d98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.251636] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.610256] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.757235] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.037931] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: SUCCESS [ 1065.038183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.113074] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.113242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.113319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.113553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.113648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.113748] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 1065.148327] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.148613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.148613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.148722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.148848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.158615] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 1065.260560] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.260765] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.260863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.261043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.261137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.261243] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 1065.291543] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.291827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.291827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.292069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.292281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.302036] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 1065.600305] env[61538]: INFO networking_nsxv3.common.synchronization [req-b971124d-c8e3-4751-acc4-816f3cf22ae5 req-d2cb4fb0-bd22-42c8-a8d1-b8831c7b3468 service nova] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_rules [ 1065.600672] env[61538]: INFO networking_nsxv3.common.synchronization [req-b971124d-c8e3-4751-acc4-816f3cf22ae5 req-d2cb4fb0-bd22-42c8-a8d1-b8831c7b3468 service nova] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_members [ 1065.600855] env[61538]: INFO networking_nsxv3.common.synchronization [req-b971124d-c8e3-4751-acc4-816f3cf22ae5 req-d2cb4fb0-bd22-42c8-a8d1-b8831c7b3468 service nova] Enqueued Resource ID: 7e7e6bd8-fac2-4516-af29-a249216acca6 with Priority: HIGHEST for action port [ 1065.603288] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_rules [ 1065.603461] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_members [ 1065.603563] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e7e6bd8-fac2-4516-af29-a249216acca6 with Priority: HIGHEST for action port [ 1065.603891] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.604056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.604118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.604319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.604407] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.605370] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.606579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.606579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.606579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.606579] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.606579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.606579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.610298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.610298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.610298] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.610298] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e7e6bd8-fac2-4516-af29-a249216acca6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.610298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.610298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.610582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.610654] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e7e6bd8-fac2-4516-af29-a249216acca6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.112566] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.112566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.113970] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e7e6bd8-fac2-4516-af29-a249216acca6 with status ACTIVE [ 1066.114185] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.114304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.114373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.114589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.114686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.114856] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.114974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.115080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.115164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.115262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.115483] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.115590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.115653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.115785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.115857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.115936] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e7e6bd8-fac2-4516-af29-a249216acca6 is going to be updated. [ 1066.118674] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.143692] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.143879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.143960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.144216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.144382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.144581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e7e6bd8-fac2-4516-af29-a249216acca6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.150757] env[61538]: INFO networking_nsxv3.common.synchronization [req-8e80716a-e392-4eac-b697-1762c6ff119a req-d8b5f317-7f9a-488b-bfd2-02ff9b88cee8 tempest-ServerActionsTestOtherB-1077210391 tempest-ServerActionsTestOtherB-1077210391-project-member] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1066.151372] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1066.151710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.151853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.151923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.152690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.152895] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.153044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.153124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.153315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.153434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.153543] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.624261] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.658834] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.658834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.658834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.658834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.682532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.682532] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.682532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.682532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.682532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.682532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.682532] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1066.712245] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.713082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.715138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.715138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.715138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.724457] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1067.130429] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.130429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.130429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.130429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.130429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.130429] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ba62abf-b989-4453-9509-66329821ead3 is going to be updated. [ 1067.170196] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 1067.170421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.170588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.170809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.171014] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.171180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.171237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.171354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.171437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.171522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.171618] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.184995] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.184995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.184995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.184995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.184995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.195447] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: IN_PROGRESS for 2s [ 1067.313103] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 1067.313407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.675769] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.678531] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.678531] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.678531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.679059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.679059] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.679059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.679059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.685737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.685937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.686956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.686956] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.189570] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b: rpc.has_security_group_logging(os_id): False [ 1068.211119] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.211266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.211331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.211552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.212424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.212651] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.213336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.213555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.213762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.213853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.214088] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.214392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.214392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.214392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.214615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.214871] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.214871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.214871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.214986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.214986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.218154] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 1068.290469] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.290469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.290469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.290621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.290690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.318119] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 1068.737062] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1068.737263] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 deletion is rescheduled due to dependency. [ 1068.737381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.205394] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: SUCCESS [ 1069.205794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.205794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.206121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.206576] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.206576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.206576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.206833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.206833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.206833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.206959] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.709300] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.211763] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ba62abf-b989-4453-9509-66329821ead3: rpc.has_security_group_logging(os_id): False [ 1070.233256] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.233472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.233608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.233884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.267461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.267921] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.268118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.268215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.268490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.268650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.268752] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ba62abf-b989-4453-9509-66329821ead3 is going to be updated. [ 1070.346155] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 1070.346433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.357706] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.357867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.357936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.358244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.358905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.374285] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: IN_PROGRESS for 2s [ 1070.378366] env[61538]: INFO networking_nsxv3.common.synchronization [req-1628239e-7f98-43fd-8b98-24247623e207 req-adc117c7-6929-4838-9924-0126969d4a1c tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1070.378366] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1070.378366] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.378366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.378366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.380340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.380742] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.380985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.381073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.381309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.381399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.381503] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.554673] env[61538]: INFO networking_nsxv3.common.synchronization [req-38aa929c-b978-4ad4-8c55-0ed0ec1c56ed req-393715de-1478-415b-b302-4bb473ca107e tempest-ServerRescueNegativeTestJSON-252212181 tempest-ServerRescueNegativeTestJSON-252212181-project-member] Enqueued Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_members [ 1070.555289] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGHEST for action security_group_members [ 1070.555608] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-f48c1e26-03f2-45d2-b576-a2404afc7d50 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.555722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.555784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.555982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.556177] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.722729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.722865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.723120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.723280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.723528] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.728505] env[61538]: INFO networking_nsxv3.common.synchronization [req-1006fa68-a3a6-477f-8610-d9c5684c8efa req-56230a8f-f04e-452e-a0c9-a69f9c2e1a22 tempest-ImagesOneServerNegativeTestJSON-513524542 tempest-ImagesOneServerNegativeTestJSON-513524542-project-member] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1070.729599] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1070.729599] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.729599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.729833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.729833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.730107] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.730107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.730107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.730279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.730332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.730412] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.891442] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.891442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.891442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.891442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.909480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.909764] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.909919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.910023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.910169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.910249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.910341] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be updated. [ 1070.937955] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.938116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.938168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.938514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.938609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.950416] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: IN_PROGRESS for 2s [ 1071.230084] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.230404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.230404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.231164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.236671] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.236782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.256240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.256638] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.256766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.257037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.257171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.260023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.260023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 is going to be updated. [ 1071.260023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.260023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.260023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.260023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.260023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.260023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.260023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.260023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.260023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be updated. [ 1071.289056] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.289245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.289293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.289531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.289671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.291467] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.291601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.291666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.291899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.292029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.303037] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 in Status: IN_PROGRESS for 2s [ 1071.303715] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: IN_PROGRESS for 2s [ 1072.400282] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: SUCCESS [ 1072.400500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.918561] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1072.918817] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NSXv3 Agent Agent loop - iteration:2 started [ 1072.962201] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 1072.962375] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 deletion is rescheduled due to dependency. [ 1072.962492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.315998] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 in Status: SUCCESS [ 1073.316491] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 deletion is rescheduled due to dependency. [ 1073.316829] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.318122] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 1073.319753] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c deletion is rescheduled due to dependency. [ 1073.319753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.334192] env[61538]: INFO networking_nsxv3.common.synchronization [None req-956d270b-8ccd-482f-b56d-1f91e01ca8e1 None None] Enqueued Resource ID: 9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c with Priority: HIGHEST for action port [ 1073.334993] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c with Priority: HIGHEST for action port [ 1073.336118] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.336342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.336486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.336796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.337333] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.841421] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c [ 1073.841664] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.841795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.841859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.842114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.842212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.842313] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c already deleted. [ 1073.842396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9aa5f51e-812e-4c72-a8d3-9bd72d7fbc7c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.256707] env[61538]: INFO networking_nsxv3.common.synchronization [req-6120f30b-d328-4359-a43c-826189a8dac1 req-e45d527f-0132-492a-ad00-05820dc6c5c7 tempest-ImagesOneServerTestJSON-1832733047 tempest-ImagesOneServerTestJSON-1832733047-project-member] Enqueued Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGHEST for action security_group_members [ 1075.256707] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGHEST for action security_group_members [ 1075.258041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-40127aa2-e264-47ea-9c74-2c16d7be1c98 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.258041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.258041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.258369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.258607] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.258761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.258870] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.259089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.259213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.259349] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40127aa2-e264-47ea-9c74-2c16d7be1c98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.763523] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.763523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.763523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.763523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.763523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.763523] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.763523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.764023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.764023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.764023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.764023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 is going to be updated. [ 1075.800979] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.802175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.802175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.802175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.802175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.813831] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 in Status: IN_PROGRESS for 2s [ 1076.074956] env[61538]: INFO networking_nsxv3.common.synchronization [None req-f705e3d1-05e2-466c-b2d1-f55910894a74 None None] Enqueued Resource ID: db98dc68-1f0f-4f45-8288-01c720e4c428 with Priority: HIGHEST for action port [ 1076.075705] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db98dc68-1f0f-4f45-8288-01c720e4c428 with Priority: HIGHEST for action port [ 1076.076099] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-db98dc68-1f0f-4f45-8288-01c720e4c428 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.076506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db98dc68-1f0f-4f45-8288-01c720e4c428" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.076506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db98dc68-1f0f-4f45-8288-01c720e4c428" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.077332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db98dc68-1f0f-4f45-8288-01c720e4c428" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.077332] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db98dc68-1f0f-4f45-8288-01c720e4c428',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.580580] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db98dc68-1f0f-4f45-8288-01c720e4c428 [ 1076.580580] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.580580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.580580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.581081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.581081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.581695] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db98dc68-1f0f-4f45-8288-01c720e4c428 already deleted. [ 1076.581695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db98dc68-1f0f-4f45-8288-01c720e4c428" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.810877] env[61538]: INFO networking_nsxv3.common.synchronization [req-e1ccb8ac-005a-45d0-be85-e083ce773c37 req-2e018cdb-a8e4-4d15-8cd6-c9a2262ebd75 tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1077.811563] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1077.813375] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.813607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.813607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.813824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.814024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.814168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.814229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.814392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.814496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.814584] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.831643] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 in Status: SUCCESS [ 1077.831643] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 deletion is rescheduled due to dependency. [ 1077.831643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.318103] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.318314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.318419] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.318791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.318887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.319128] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.319230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.319313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.319460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.319555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.319644] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1078.363805] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.363948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.364055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.364325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.364474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.378863] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1078.988547] env[61538]: INFO networking_nsxv3.common.synchronization [req-326ffa23-3dd6-4e06-bfbf-3fdf60f04ba6 req-301b3237-a1e1-4a21-880e-a44c82b25c30 tempest-ServersAdminTestJSON-1231961305 tempest-ServersAdminTestJSON-1231961305-project-member] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 1078.990130] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGHEST for action security_group_members [ 1078.990685] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.992128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.992128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.992128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.992128] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.992128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.992128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.992128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.992128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.992128] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.496875] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.496875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.496875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.496875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.519142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.519414] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.519532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.519591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.522022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.522022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.522022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be updated. [ 1079.551833] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.551960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.552040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.552255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.552398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.563071] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: IN_PROGRESS for 2s [ 1079.631292] env[61538]: INFO networking_nsxv3.common.synchronization [req-08679ac6-0829-40fd-81a7-fd0f8caf6bd2 req-1644647e-475c-4130-97d4-e76dab33d389 tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_members [ 1079.631849] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e with Priority: HIGHEST for action security_group_members [ 1079.632166] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.632292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.632362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.632564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.632689] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.632788] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.632847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.632985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.633082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.633171] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('183bb0f5-0c4a-4a88-8d23-eca114a3a62e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.136811] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.140312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.140312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.140312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.163851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.163851] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.163851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.163851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.164092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.164393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.164564] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e is going to be updated. [ 1080.198298] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.200020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.200020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.200020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.200020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.208640] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e in Status: IN_PROGRESS for 2s [ 1080.334029] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-45 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.334412] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.334412] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.334953] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.334953] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.339389] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.339514] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.339721] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.339871] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.340121] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.340244] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.340349] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.340555] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.340612] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.340791] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.340872] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.371026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.371026] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.371026] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.371026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-45" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.371026] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-2147b830-281d-4a24-90d1-22eccefc4c5c taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.371816] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.372056] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.372500] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.372760] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2147b830-281d-4a24-90d1-22eccefc4c5c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.389745] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1080.390112] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 1080.390353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.876242] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.876606] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.876716] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.877091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.877270] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.877683] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.877874] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.877966] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.878212] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.878394] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.878740] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.878927] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.882547] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.882924] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.883118] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.883294] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 2147b830-281d-4a24-90d1-22eccefc4c5c is going to be updated. [ 1080.910858] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.910858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.911075] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.911415] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.911570] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.911805] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.587190] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 in Status: SUCCESS [ 1081.587578] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 deletion is rescheduled due to dependency. [ 1081.587721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.681505] env[61538]: INFO networking_nsxv3.common.synchronization [req-b3555fb2-0dcd-4597-98a0-940f7a11b8e3 req-16499c30-1d47-45ad-830f-f1938cc162a6 service nova] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_rules [ 1081.681831] env[61538]: INFO networking_nsxv3.common.synchronization [req-b3555fb2-0dcd-4597-98a0-940f7a11b8e3 req-16499c30-1d47-45ad-830f-f1938cc162a6 service nova] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 1081.682458] env[61538]: INFO networking_nsxv3.common.synchronization [req-b3555fb2-0dcd-4597-98a0-940f7a11b8e3 req-16499c30-1d47-45ad-830f-f1938cc162a6 service nova] Enqueued Resource ID: 2147b830-281d-4a24-90d1-22eccefc4c5c with Priority: HIGHEST for action port [ 1081.685622] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_rules [ 1081.685966] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 1081.686127] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2147b830-281d-4a24-90d1-22eccefc4c5c with Priority: HIGHEST for action port [ 1081.686783] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.686994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.687117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.687692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.687692] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.688558] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.688784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.688784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.689021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.689889] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.690042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.690149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.690221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.690727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.690727] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.691765] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2147b830-281d-4a24-90d1-22eccefc4c5c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.691907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.692065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.692209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.692308] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2147b830-281d-4a24-90d1-22eccefc4c5c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.194560] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.195709] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.195905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.198417] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2147b830-281d-4a24-90d1-22eccefc4c5c with status ACTIVE [ 1082.198727] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.198849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.199207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.199207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.199357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.199422] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.199561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.199743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.199787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.199994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.200081] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.200168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.200221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.200341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.200417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.200499] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2147b830-281d-4a24-90d1-22eccefc4c5c is going to be updated. [ 1082.218424] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e in Status: SUCCESS [ 1082.219407] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 183bb0f5-0c4a-4a88-8d23-eca114a3a62e deletion is rescheduled due to dependency. [ 1082.219407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-183bb0f5-0c4a-4a88-8d23-eca114a3a62e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.225255] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.225339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.225381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.225607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.225748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.226297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2147b830-281d-4a24-90d1-22eccefc4c5c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.698033] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.138316] env[61538]: INFO networking_nsxv3.common.synchronization [req-336bb88d-8148-4ee5-8e0f-7fc987621b38 req-a6ea9738-acd5-4dc4-bfac-d74365a88ae2 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1083.140030] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1083.140445] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.142353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.142353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.142353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.142353] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.142353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.142353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.142353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.142353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.142353] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.200309] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.202087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.202087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.202087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.202087] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.202087] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be updated. [ 1083.256314] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.256314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.256746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.256746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.257056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.273699] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: IN_PROGRESS for 2s [ 1083.644393] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.644635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.644635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.644989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.644989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.645207] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.645333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.645384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.645525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.645603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.645692] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 already deleted. [ 1083.645773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.962694] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.963082] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.963220] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.963551] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.963923] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.964130] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.964271] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.964790] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.964790] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.965143] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.965143] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.965243] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.965349] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.965471] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.965583] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.965722] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.987498] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.987658] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.987782] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.987981] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.988327] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.988521] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.988727] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.989092] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.989252] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('281269ec-aad9-4fd1-bf3e-ba8f1bc9923f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.492298] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.492518] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.492581] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.492864] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.493040] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.493206] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 281269ec-aad9-4fd1-bf3e-ba8f1bc9923f not found, creating... [ 1084.493460] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.493621] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.493744] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.493963] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.494121] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.494406] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.494564] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.494688] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.494933] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.495051] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.495197] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 281269ec-aad9-4fd1-bf3e-ba8f1bc9923f is going to be created. [ 1084.519740] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.520057] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.520327] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.520812] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.521165] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.521411] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.283757] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 1085.284100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.284244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.284464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.284661] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.284783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.284846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.285067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.285172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.285286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.285384] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.295714] env[61538]: INFO networking_nsxv3.common.synchronization [req-336bb88d-8148-4ee5-8e0f-7fc987621b38 req-ec5b4200-390b-4a48-8078-d1a7e2ec92f4 service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1085.298214] env[61538]: INFO networking_nsxv3.common.synchronization [req-336bb88d-8148-4ee5-8e0f-7fc987621b38 req-ec5b4200-390b-4a48-8078-d1a7e2ec92f4 service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1085.298504] env[61538]: INFO networking_nsxv3.common.synchronization [req-336bb88d-8148-4ee5-8e0f-7fc987621b38 req-ec5b4200-390b-4a48-8078-d1a7e2ec92f4 service nova] Enqueued Resource ID: 281269ec-aad9-4fd1-bf3e-ba8f1bc9923f with Priority: HIGHEST for action port [ 1085.299494] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1085.300940] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1085.301223] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 281269ec-aad9-4fd1-bf3e-ba8f1bc9923f with Priority: HIGHEST for action port [ 1085.302453] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.302764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.302889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.303200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.303379] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.307131] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.307131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.307131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.307131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.307131] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.307131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.307131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.307131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.307131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.307131] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.307131] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.307131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.307131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.307997] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.308159] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('281269ec-aad9-4fd1-bf3e-ba8f1bc9923f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.789135] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.789135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.789135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.789135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.789135] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.789135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.789135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.789678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.789678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.789767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.789916] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.790069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.790143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.790240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.790411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.790521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.790564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.791288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.791288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.791288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.791288] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.810426] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.811592] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.811716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.812344] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 281269ec-aad9-4fd1-bf3e-ba8f1bc9923f with status ACTIVE [ 1085.812344] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.812344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.812344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.812563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.812613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.812762] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.812855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.812913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.813107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.813223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.813420] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.813518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.813586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.813808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.813936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.814650] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 281269ec-aad9-4fd1-bf3e-ba8f1bc9923f is going to be updated. [ 1085.843419] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.843598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.843696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.843848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.844011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.844171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-281269ec-aad9-4fd1-bf3e-ba8f1bc9923f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.293583] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bc3281e-af92-4997-a592-c0e030784b0d: rpc.has_security_group_logging(os_id): False [ 1086.312727] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.312909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.312971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.313363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.313363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.313614] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.313736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.313813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.313969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.314074] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.314272] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.314386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.314442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.314581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.314647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.314771] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.314876] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.314938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.315059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.315134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.315218] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be updated. [ 1086.316460] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.390771] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.390934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.391010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.391242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.391395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.410909] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: IN_PROGRESS for 2s [ 1086.488686] env[61538]: INFO networking_nsxv3.common.synchronization [req-dae91d74-a042-4051-bcd6-48b591c36dcd req-b3fe68cc-b718-4527-8113-2f051697f78f tempest-InstanceActionsNegativeTestJSON-1303272001 tempest-InstanceActionsNegativeTestJSON-1303272001-project-member] Enqueued Resource ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 with Priority: HIGHEST for action security_group_members [ 1086.489300] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 with Priority: HIGHEST for action security_group_members [ 1086.489658] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-41199763-c4be-4ed6-bd49-9e22e2390a80 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.489784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.489844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.490669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.490968] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.490968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.491086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.492423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.492423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.492423] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41199763-c4be-4ed6-bd49-9e22e2390a80',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.820791] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.820990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.820990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.821276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.821276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.821395] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be created. [ 1086.855803] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.856059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.856192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.856546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.856885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.870348] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: UNINITIALIZED for 2s [ 1086.993665] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.993974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.993974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.994399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.994399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.994575] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.994676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.994676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.995140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.995308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.995614] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 already deleted. [ 1086.995731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.287762] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.288039] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-851" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.288188] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-851" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.288562] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-851" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.288917] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.289111] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.289378] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.289510] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.289691] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.289918] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.290045] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.290162] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.290277] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.290392] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.290502] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.290641] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.313048] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.313298] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1087.313444] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.313704] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-851" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.314069] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-208c9c7b-7408-4bea-a6d1-34d97f61dabf taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.314271] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-208c9c7b-7408-4bea-a6d1-34d97f61dabf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.314404] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-208c9c7b-7408-4bea-a6d1-34d97f61dabf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.314840] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-208c9c7b-7408-4bea-a6d1-34d97f61dabf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.315098] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('208c9c7b-7408-4bea-a6d1-34d97f61dabf',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.818611] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.819024] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.819203] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.819568] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.819776] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.820016] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 208c9c7b-7408-4bea-a6d1-34d97f61dabf not found, creating... [ 1087.820443] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.820551] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.820807] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.821032] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.821252] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.821527] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.821716] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.821847] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.822154] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.822340] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.822499] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 208c9c7b-7408-4bea-a6d1-34d97f61dabf is going to be created. [ 1087.849146] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.849146] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.849146] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.849462] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.849658] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.849933] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-208c9c7b-7408-4bea-a6d1-34d97f61dabf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.431440] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 1088.431440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.845125] env[61538]: INFO networking_nsxv3.common.synchronization [req-dae91d74-a042-4051-bcd6-48b591c36dcd req-645e71dc-4ac1-4afb-b7f7-f5fe1f60d951 service nova] Enqueued Resource ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 with Priority: HIGHEST for action security_group_rules [ 1088.845362] env[61538]: INFO networking_nsxv3.common.synchronization [req-dae91d74-a042-4051-bcd6-48b591c36dcd req-645e71dc-4ac1-4afb-b7f7-f5fe1f60d951 service nova] Enqueued Resource ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 with Priority: HIGHEST for action security_group_members [ 1088.845524] env[61538]: INFO networking_nsxv3.common.synchronization [req-dae91d74-a042-4051-bcd6-48b591c36dcd req-645e71dc-4ac1-4afb-b7f7-f5fe1f60d951 service nova] Enqueued Resource ID: 208c9c7b-7408-4bea-a6d1-34d97f61dabf with Priority: HIGHEST for action port [ 1088.846165] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 with Priority: HIGHEST for action security_group_rules [ 1088.846308] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 with Priority: HIGHEST for action security_group_members [ 1088.846400] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 208c9c7b-7408-4bea-a6d1-34d97f61dabf with Priority: HIGHEST for action port [ 1088.850033] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41199763-c4be-4ed6-bd49-9e22e2390a80 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.850033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.850033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.850033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.850033] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41199763-c4be-4ed6-bd49-9e22e2390a80',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.850033] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-41199763-c4be-4ed6-bd49-9e22e2390a80 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.850709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.850709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.850709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.850799] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.850884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.850967] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.851159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.851250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.851340] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41199763-c4be-4ed6-bd49-9e22e2390a80',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.852370] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-208c9c7b-7408-4bea-a6d1-34d97f61dabf taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.852481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-208c9c7b-7408-4bea-a6d1-34d97f61dabf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.852541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-208c9c7b-7408-4bea-a6d1-34d97f61dabf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.852731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-208c9c7b-7408-4bea-a6d1-34d97f61dabf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.852859] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('208c9c7b-7408-4bea-a6d1-34d97f61dabf',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.886792] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1088.886792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.886792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.886792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.886792] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.886792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.886792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.886792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.887347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.887347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.887347] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.354979] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41199763-c4be-4ed6-bd49-9e22e2390a80',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.356284] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-41199763-c4be-4ed6-bd49-9e22e2390a80 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.356441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.356636] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 208c9c7b-7408-4bea-a6d1-34d97f61dabf with status ACTIVE [ 1089.357352] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.357352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.357352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.357352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.357556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.357680] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.357780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.357862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.358571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.358741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.358998] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.359787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.359787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.359787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.359787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.359787] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 208c9c7b-7408-4bea-a6d1-34d97f61dabf is going to be updated. [ 1089.384357] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.384796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.384796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.384945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.385150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.385366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-208c9c7b-7408-4bea-a6d1-34d97f61dabf" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.389881] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.390241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.390241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.390412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.390412] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.390562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.390562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.390722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.390784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.390850] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.390996] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.391210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.391210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.391406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.391406] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.391932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.391932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.391932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.391932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.391932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.391932] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.667497] env[61538]: INFO networking_nsxv3.common.synchronization [req-809e15f0-4e5f-4d19-bfec-95e00f9b6d44 req-cbb1375b-029b-4eeb-869f-d096b875c478 tempest-ImagesTestJSON-711834106 tempest-ImagesTestJSON-711834106-project-member] Enqueued Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1089.668057] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b with Priority: HIGHEST for action security_group_members [ 1089.668360] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.668472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.668538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.668754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.668899] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.668992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.669290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.669450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.669534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.669644] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b1455b-d54a-44cb-a3ce-90cc7f9dc00b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.864947] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41199763-c4be-4ed6-bd49-9e22e2390a80',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.895275] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1636da8b-a16b-42d3-874d-5d8471397fd6: rpc.has_security_group_logging(os_id): False [ 1089.914701] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.914907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.914907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.915281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.915281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.915586] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.915586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.915586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.915759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.915759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.915910] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.915972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.916038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.916227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.916227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.916437] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.916727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.916727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.916727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.917082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.917082] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be created. [ 1089.979546] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.979776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.979880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.980114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.980300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.992353] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1090.035456] env[61538]: INFO networking_nsxv3.common.synchronization [req-c22f8a89-722a-4522-9a4e-8770bc454e74 req-e005ce5f-a84f-4446-bb53-4d8fedfbf09a tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1090.036050] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1090.036208] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.036329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.036394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.036601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.036828] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.036929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.036989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.037257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.037373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.037499] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.172535] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.172535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.172535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.172825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.172825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.173013] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.173114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.173211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.173318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.173390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.173471] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b is going to be updated. [ 1090.203054] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.203054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.203054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.203054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.203370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.212881] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: IN_PROGRESS for 2s [ 1090.369449] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.369449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.369449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.369449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.369449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.369449] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 is going to be created. [ 1090.411656] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.412326] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.412631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.413078] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.413356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.426609] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 in Status: UNINITIALIZED for 2s [ 1090.540091] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.540594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.540594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.540774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.540812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.541038] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.541140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.541795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.541795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.541795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.541795] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb is going to be updated. [ 1090.572491] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.572491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.572687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.572820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.573572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.584496] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: IN_PROGRESS for 2s [ 1090.820106] env[61538]: INFO networking_nsxv3.common.synchronization [req-2cea6588-0461-4378-8913-1108b34132cc req-cab9b1ac-cc87-4f7d-b430-1970369738ab tempest-ServerActionsTestOtherB-1077210391 tempest-ServerActionsTestOtherB-1077210391-project-member] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1090.820590] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1090.820993] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.821216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.821311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.821496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.822274] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.822274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.822274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.822274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.822589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.822589] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.324658] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.324938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.325124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.325511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.325596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.325945] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.326173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.326293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.326600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.326736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.326915] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1091.370152] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.370482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.370482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.370620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.370725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.384477] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1091.963859] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.964217] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.964217] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.964465] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.964853] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.967043] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.967258] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.967556] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.969302] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.969598] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.969750] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.969892] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.970056] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.970218] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.970367] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.970546] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.995745] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.996113] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.996356] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.996678] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.997163] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.997803] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.997803] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.998020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.998186] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.011438] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1092.011438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.224093] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b in Status: SUCCESS [ 1092.224499] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b1455b-d54a-44cb-a3ce-90cc7f9dc00b deletion is rescheduled due to dependency. [ 1092.224673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b1455b-d54a-44cb-a3ce-90cc7f9dc00b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.441998] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 in Status: SUCCESS [ 1092.442269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.442458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.442673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.442897] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.442999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.443061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.443287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.443370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.443408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.443502] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41199763-c4be-4ed6-bd49-9e22e2390a80',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.500775] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.501422] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.501422] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.501674] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.501759] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.501861] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc not found, creating... [ 1092.502169] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.503355] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.503355] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.503355] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.503355] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.503355] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.506934] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.507187] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.510309] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.510309] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.510309] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc is going to be created. [ 1092.537413] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.537603] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.537673] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.538104] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.538485] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.547035] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.597518] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: SUCCESS [ 1092.597518] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb deletion is rescheduled due to dependency. [ 1092.597518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.952854] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-41199763-c4be-4ed6-bd49-9e22e2390a80 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.953107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.953243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.953531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.953742] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.953897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.953984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.954191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.954316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.954439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.954578] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-41199763-c4be-4ed6-bd49-9e22e2390a80 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.954674] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.954736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.954873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.955069] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.955198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.955257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.955407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.955487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.955566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.955669] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41199763-c4be-4ed6-bd49-9e22e2390a80',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.299648] env[61538]: INFO networking_nsxv3.common.synchronization [req-2cea6588-0461-4378-8913-1108b34132cc req-d0beb612-3200-433e-ba6f-74ea11863a42 service nova] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 1093.299959] env[61538]: INFO networking_nsxv3.common.synchronization [req-2cea6588-0461-4378-8913-1108b34132cc req-d0beb612-3200-433e-ba6f-74ea11863a42 service nova] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1093.299959] env[61538]: INFO networking_nsxv3.common.synchronization [req-2cea6588-0461-4378-8913-1108b34132cc req-d0beb612-3200-433e-ba6f-74ea11863a42 service nova] Enqueued Resource ID: b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc with Priority: HIGHEST for action port [ 1093.300779] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 1093.300779] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1093.300779] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc with Priority: HIGHEST for action port [ 1093.301841] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.302558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.302558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.302558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.302558] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.303137] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.303257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.303469] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.303565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.303622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.303832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.303923] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.395621] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1093.395621] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 deletion is rescheduled due to dependency. [ 1093.395621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.396950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.396950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.396950] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.396950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.396950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.396950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.396950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.397393] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.457838] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41199763-c4be-4ed6-bd49-9e22e2390a80: rpc.has_security_group_logging(os_id): False [ 1093.476392] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.476611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.476611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.477098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.477098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.477239] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.477239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.477386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.477430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.477567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.477645] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.477739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.477802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.477912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.477985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.478185] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.478278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.478336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.478483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.478535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.478618] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 is going to be created. [ 1093.540222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.540222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.540222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.540222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.540222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.550617] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 in Status: IN_PROGRESS for 2s [ 1093.806853] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.806955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.809162] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc with status ACTIVE [ 1093.809407] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.809520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.809580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.809743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.809859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.810047] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.810146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.810210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.810366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.810444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.810622] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.810713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.810772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.810899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.810971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.811074] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc is going to be updated. [ 1093.838939] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.839112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.839192] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.839481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.839652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.839840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b793a557-dfec-4ca2-b8b7-9c9c6fcec8cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.866604] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.866794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.866848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.867282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.867447] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.899644] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.343439] env[61538]: INFO networking_nsxv3.common.synchronization [req-2b26c3f0-36a3-4e5d-8c32-a9bc4f9f1472 req-647f4268-44c1-4082-b3b4-6615249803e9 tempest-ServerRescueNegativeTestJSON-252212181 tempest-ServerRescueNegativeTestJSON-252212181-project-member] Enqueued Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 1094.344047] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 1094.344431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.344605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.344711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.344949] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.345236] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.345236] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.345370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.345485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.345575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.345668] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.371183] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.402073] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.850347] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.874086] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.904177] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.904364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.904364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.904614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.904689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.904787] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1094.934617] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.934757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.934831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.935063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.935212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.944147] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1095.353831] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.377060] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1095.377203] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1095.419369] env[61538]: INFO networking_nsxv3.common.synchronization [None req-ead7aa20-0be8-4092-a2e1-804aeb3ed3ca tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_rules [ 1095.419369] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_rules [ 1095.422140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.422140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.422140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.422140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.422140] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.516457] env[61538]: INFO networking_nsxv3.common.synchronization [None req-9002e793-c8ed-46a6-8595-a2b24d5bce1c tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_rules [ 1095.516457] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_rules [ 1095.516457] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.516457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.580792] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 in Status: SUCCESS [ 1095.580792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.858430] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.858764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.858764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.859015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.859133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.859257] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 is going to be updated. [ 1095.895959] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.896239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.896239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.896490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.896647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.907708] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: IN_PROGRESS for 2s [ 1095.947854] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.948097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.948097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.948276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.948367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.948463] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c already deleted. [ 1095.948541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.948683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.948868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.948954] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.385055] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.385055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.385055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.385055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.410365] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1096.410365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.410365] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1096.447978] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.448100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.448262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.448347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.459185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.459185] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1096.459185] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1096.459185] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1096.477684] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.477857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.478224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.478224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.478351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.478401] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c already deleted. [ 1096.478450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.500593] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.500755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.500822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.501582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.503818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.504950] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1096.648126] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.648391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.648441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.648778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.649141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.649488] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1096.752621] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.753812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.753812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.753812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.754081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.754468] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1096.754468] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'575a9d53-3464-492c-a0bb-d9d7bb8b0eca', '1636da8b-a16b-42d3-874d-5d8471397fd6', '3bc3281e-af92-4997-a592-c0e030784b0d', '11ca0972-f93e-4e78-b9f2-0d09798b331c', '794d6c9f-f896-426d-a29e-0a532c759616', 'febfb45e-9229-49aa-8dfc-5f90dbca1a4c', '60e126c8-91fd-48ea-83dd-501de69e291d', 'f48c1e26-03f2-45d2-b576-a2404afc7d50', '40127aa2-e264-47ea-9c74-2c16d7be1c98', '4854c6da-988b-40cb-9c61-b312f09d4a28', '3245ba1b-68f2-4ade-b795-a712f120d8b1', 'cc1293ec-0409-4faf-afb6-bd4a0b1e16ab', '7fcbd20b-13e3-44c4-bf9a-746a1da000dc', '87950fcb-64a8-4442-9ae9-01d668ddee9e', '7e4fbaf8-8019-44da-bb3b-478c3b16eb47', '7ba62abf-b989-4453-9509-66329821ead3', 'f59fc458-059e-4374-b3e2-7acaf6e64082', '11dde3c4-ea2c-4769-852b-b7d0f666da42', 'e844ad3e-80cf-412c-a6ea-015ade97cb73', '550dcd2b-7021-4904-a80d-13c93ea25fe6', '3e3d8835-25b4-4cc2-a332-a16e5b92a588', '1447a613-37bb-4237-a379-2b84dc1ad40d', '16598403-384b-4b7b-9e19-2f2d3b7596b6', '563f2c80-ee39-48ef-8436-22a95e9bc54a', '463a8c39-ee54-4fb8-a9f5-3967b4233a2e', '8feb07e8-1e39-437e-8497-dad4b8420d11', '2824e3bd-37f2-4e0d-afe6-4e256a5a8cff', '1aac9359-4a9b-4456-9463-ba08a19c23d6', '183bb0f5-0c4a-4a88-8d23-eca114a3a62e', '9a429894-62fb-4375-9201-aa412f677b75', '6798f697-f08e-4d7d-8b6e-6fb13201518f', '5b226ae7-1968-4740-8cac-2825cb2bf00f', '27cb37c1-ffde-4f82-835b-823e403e1b9e', '0af22a35-c045-464f-ae65-fa54f84e116a', '41199763-c4be-4ed6-bd49-9e22e2390a80', '65ce3e97-db41-488c-9988-1959f1dc1965', 'acdbba8b-e86f-40a9-8892-22733abd6f87', '7c2a68f3-1e90-484c-934f-cd67fcc8be6b', '365fd2af-187a-43da-9017-8bc6e06e1910', '4d15333c-499a-45ad-a20b-dad70f7f90bb', 'ded91e44-4a5f-4d2c-a527-86674f66c321', '500d868a-59d3-4e7e-a5ec-63123eb42a2d', '55b1455b-d54a-44cb-a3ce-90cc7f9dc00b', 'c83b44db-0e9f-4fe1-b8a5-20122469f727', 'e51a7e95-5364-42cc-944f-ced83c3e81b9', 'c9f9cc04-e7d3-4a55-ba09-c74518d114dc', '580370e7-ea25-4027-912b-de772679071c'} {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1096.754669] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1096.778230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.778513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.778513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.778869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.779076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.779222] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1096.779364] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1096.779593] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1096.876805] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.876985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.877059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.877271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.878351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.878642] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1096.878735] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1096.878808] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1096.878878] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1096.878959] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1096.879451] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGH for action security_group_rules [ 1096.879451] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGH for action security_group_rules [ 1096.879451] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGH for action security_group_rules [ 1096.879451] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGH for action security_group_rules [ 1096.879451] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGH for action security_group_rules [ 1096.879451] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGH for action security_group_rules [ 1096.879451] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGH for action security_group_rules [ 1096.879775] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGH for action security_group_rules [ 1096.879775] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGH for action security_group_rules [ 1096.879775] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGH for action security_group_rules [ 1096.879775] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGH for action security_group_rules [ 1096.879775] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGH for action security_group_rules [ 1096.879775] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGH for action security_group_rules [ 1096.880035] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGH for action security_group_rules [ 1096.880035] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGH for action security_group_rules [ 1096.880035] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGH for action security_group_rules [ 1096.880035] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGH for action security_group_rules [ 1096.880035] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGH for action security_group_rules [ 1096.880224] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGH for action security_group_rules [ 1096.880224] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGH for action security_group_rules [ 1096.880287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.954045] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1096.954307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.954480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.954717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.954909] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.955432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.955432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.955432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.955432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.955432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.955682] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.289873] env[61538]: INFO networking_nsxv3.common.synchronization [req-49f0236a-1506-4ccb-9e35-dd0efef2eeb3 req-86662f13-2a06-43b9-8797-b5ac62522f74 tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1097.290449] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1097.290602] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca with Priority: HIGH for action security_group_rules [ 1097.290703] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGH for action security_group_rules [ 1097.290801] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e126c8-91fd-48ea-83dd-501de69e291d with Priority: HIGH for action security_group_rules [ 1097.291084] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 with Priority: HIGH for action security_group_rules [ 1097.291084] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGH for action security_group_rules [ 1097.293123] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 with Priority: HIGH for action security_group_rules [ 1097.293266] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 with Priority: HIGH for action security_group_rules [ 1097.293373] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGH for action security_group_rules [ 1097.293472] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e with Priority: HIGH for action security_group_rules [ 1097.293604] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGH for action security_group_rules [ 1097.293765] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGH for action security_group_rules [ 1097.293880] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab with Priority: HIGH for action security_group_rules [ 1097.293979] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 with Priority: HIGH for action security_group_rules [ 1097.294080] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 with Priority: HIGH for action security_group_rules [ 1097.294173] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 with Priority: HIGH for action security_group_rules [ 1097.294260] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGH for action security_group_rules [ 1097.294336] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 with Priority: HIGH for action security_group_rules [ 1097.294427] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794d6c9f-f896-426d-a29e-0a532c759616 with Priority: HIGH for action security_group_rules [ 1097.294507] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGH for action security_group_rules [ 1097.294594] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGH for action security_group_rules [ 1097.294924] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.295064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.295142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.295331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.295495] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.295595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.295654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.295803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.295891] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.295987] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.297999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.298153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.298201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.298387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.298488] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('575a9d53-3464-492c-a0bb-d9d7bb8b0eca',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.299616] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.299791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.299863] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.300041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.300099] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.301180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60e126c8-91fd-48ea-83dd-501de69e291d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.301287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.301400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.301511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.301586] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60e126c8-91fd-48ea-83dd-501de69e291d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.303322] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.304648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.304648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.304648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.304648] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e4fbaf8-8019-44da-bb3b-478c3b16eb47',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.304648] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.305032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.305032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.305032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.305032] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.305998] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e844ad3e-80cf-412c-a6ea-015ade97cb73 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.306122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.306194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.306383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.306456] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e844ad3e-80cf-412c-a6ea-015ade97cb73',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.307742] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11dde3c4-ea2c-4769-852b-b7d0f666da42 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.307742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.307742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.307742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.307742] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11dde3c4-ea2c-4769-852b-b7d0f666da42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.312029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.312029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.312029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.312029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.312029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.312600] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87950fcb-64a8-4442-9ae9-01d668ddee9e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.312600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.312600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.312887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.312887] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87950fcb-64a8-4442-9ae9-01d668ddee9e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.314341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.314563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.314563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.314800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.314800] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.316342] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.316595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.316708] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.316922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.317030] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.317916] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.318071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.318133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.318288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.318368] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc1293ec-0409-4faf-afb6-bd4a0b1e16ab',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.319467] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3245ba1b-68f2-4ade-b795-a712f120d8b1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.319592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.319665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.319842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.319961] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3245ba1b-68f2-4ade-b795-a712f120d8b1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.321987] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4854c6da-988b-40cb-9c61-b312f09d4a28 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.322111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.322173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.322360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.322444] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4854c6da-988b-40cb-9c61-b312f09d4a28',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.323295] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40127aa2-e264-47ea-9c74-2c16d7be1c98 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.324044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.324044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.324044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.324044] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40127aa2-e264-47ea-9c74-2c16d7be1c98',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.324598] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.324734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.324792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.324921] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.325522] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.328108] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f48c1e26-03f2-45d2-b576-a2404afc7d50 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.328281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.328362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.328638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.328771] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f48c1e26-03f2-45d2-b576-a2404afc7d50',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.329678] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-794d6c9f-f896-426d-a29e-0a532c759616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.329809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.329851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.330046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.330146] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('794d6c9f-f896-426d-a29e-0a532c759616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.331602] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.331750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.331750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.332048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.332048] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.333140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.333140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.333140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.333140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.333140] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.457537] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.801551] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.801782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.801782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.802097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.813547] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.813765] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.813765] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.813970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.814538] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.814768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.814876] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.815022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.815113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.815206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.815383] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.817853] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.818040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.818233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.818448] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.818624] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.818745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.818815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.818960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.819127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.819207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.819287] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.824374] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.824618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.828325] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.828496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.828599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.828758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.828896] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.828995] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.830137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.830290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.830382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.830470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.830638] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.836935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.837233] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.837479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.837479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.837660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.837839] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.837839] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1097.841524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.841692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.844214] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.844347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.844409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.844590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.844879] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.844983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.845064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.845211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.845295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.845381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.845467] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.851599] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.851743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.851797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.851974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.852139] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.852228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.852286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.852425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.852500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.852578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.852660] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.862089] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.862236] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.866250] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.866381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.868277] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.868277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.906699] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.906912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.907801] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.907900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.908640] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.908750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.909462] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.909560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.914022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.914022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.914022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.914022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.914022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.914022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.914022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.914022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60e126c8-91fd-48ea-83dd-501de69e291d is going to be deleted. [ 1097.915034] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.915128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.915188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.915383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.917693] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.917808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.918493] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1097.918838] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.918906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.920093] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1097.920498] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.920581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.929041] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1097.929428] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: SUCCESS [ 1097.929639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.949156] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1097.950019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.950269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.950364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.950602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.950757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.956671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.956809] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 794d6c9f-f896-426d-a29e-0a532c759616 is going to be deleted. [ 1097.957771] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.958016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.960808] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e51a7e95-5364-42cc-944f-ced83c3e81b9: rpc.has_security_group_logging(os_id): False [ 1097.962329] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1097.980356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.980546] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11dde3c4-ea2c-4769-852b-b7d0f666da42 is going to be deleted. [ 1097.981544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.981775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.983357] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.983480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.004153] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.004339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.019222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.019372] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3245ba1b-68f2-4ade-b795-a712f120d8b1 is going to be deleted. [ 1098.020761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.020761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.022531] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.022649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.044679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.044821] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e4fbaf8-8019-44da-bb3b-478c3b16eb47 is going to be deleted. [ 1098.046227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.046493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.056819] env[61538]: INFO networking_nsxv3.common.synchronization [req-06374aa5-19f7-433c-9c13-0aca062406f4 req-924048e5-a15b-49c4-b38f-4fd1bdb7a366 tempest-ServersTestJSON-1123416272 tempest-ServersTestJSON-1123416272-project-member] Enqueued Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_members [ 1098.057394] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGHEST for action security_group_members [ 1098.057709] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.057836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.057902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.058199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.058361] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.058466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.058527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.058678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.058824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.058927] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.070036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.070036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.127342] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.131245] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4854c6da-988b-40cb-9c61-b312f09d4a28 is going to be deleted. [ 1098.131245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.131245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.132447] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.132812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.175186] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.176218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.222978] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1098.225651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.225934] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40127aa2-e264-47ea-9c74-2c16d7be1c98 is going to be deleted. [ 1098.226834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.227102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.260401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.260401] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be deleted. [ 1098.261656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.261656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.291532] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.291781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.310550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.310745] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f48c1e26-03f2-45d2-b576-a2404afc7d50 is going to be deleted. [ 1098.311872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.312191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.324024] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.325828] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.334622] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.357414] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.357619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.362036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.362192] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be deleted. [ 1098.363623] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.363784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.364152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.364395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.364624] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.364715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.364780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.364978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.365157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.365157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.365277] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.365371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.365889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.365889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.365889] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.365889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.365889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.366161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.366161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.366161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.366513] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.367221] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.367336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.370526] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.370526] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.370526] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.370526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.371896] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.371896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.371896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.392143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.392143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.408033] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.408033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.409993] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.410435] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.411009] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.412025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.412025] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.412025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.412025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.412633] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.412901] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.413252] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.413499] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.414266] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.414266] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.414266] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.414266] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.414266] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.416249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.416301] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc1293ec-0409-4faf-afb6-bd4a0b1e16ab is going to be deleted. [ 1098.417778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.417993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.465634] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.466374] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1098.466374] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.466374] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.466638] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-169863f3-63da-4e6e-8dbb-514951796bf8 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.466757] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-169863f3-63da-4e6e-8dbb-514951796bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.466797] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-169863f3-63da-4e6e-8dbb-514951796bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.467138] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-169863f3-63da-4e6e-8dbb-514951796bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.467293] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('169863f3-63da-4e6e-8dbb-514951796bf8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.521897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.522538] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87950fcb-64a8-4442-9ae9-01d668ddee9e is going to be deleted. [ 1098.523759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.524157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.524365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.524563] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be deleted. [ 1098.526373] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.526742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.526929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.527344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.527525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.527832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.528079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.528514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.561330] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.561455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.581892] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.582157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.583377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.583547] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e844ad3e-80cf-412c-a6ea-015ade97cb73 is going to be deleted. [ 1098.584499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.584727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.631442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.631442] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.631601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.631601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.632023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.632023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.632023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1098.633774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.634027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.634153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.634530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60e126c8-91fd-48ea-83dd-501de69e291d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.634712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.634901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.635021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.635375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-794d6c9f-f896-426d-a29e-0a532c759616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.635561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.635743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.635850] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.635991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11dde3c4-ea2c-4769-852b-b7d0f666da42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.636155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.636552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.636806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.637049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3245ba1b-68f2-4ade-b795-a712f120d8b1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.637832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.638040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.638183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.638323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e4fbaf8-8019-44da-bb3b-478c3b16eb47" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.638469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.638644] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.638817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.639209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4854c6da-988b-40cb-9c61-b312f09d4a28" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.639450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.639557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.639557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.639731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40127aa2-e264-47ea-9c74-2c16d7be1c98" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.640009] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.640593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.640719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.640864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.641043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.641399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.641524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.641670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f48c1e26-03f2-45d2-b576-a2404afc7d50" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.641923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.642114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.712134] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.712391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.726448] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.726623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.735175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.735325] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 575a9d53-3464-492c-a0bb-d9d7bb8b0eca is going to be deleted. [ 1098.736335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.736525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.736621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.736784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc1293ec-0409-4faf-afb6-bd4a0b1e16ab" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.736902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.737299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.759504] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.759714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.812037] env[61538]: INFO networking_nsxv3.common.synchronization [None req-ca86fe4c-ab72-42d7-8371-b4ec9aad9f17 None None] Enqueued Resource ID: 61eaae7c-9ec2-4f7c-b652-5486ca07f3d6 with Priority: HIGHEST for action port [ 1098.812669] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61eaae7c-9ec2-4f7c-b652-5486ca07f3d6 with Priority: HIGHEST for action port [ 1098.812710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-61eaae7c-9ec2-4f7c-b652-5486ca07f3d6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.812898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61eaae7c-9ec2-4f7c-b652-5486ca07f3d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.812898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61eaae7c-9ec2-4f7c-b652-5486ca07f3d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.813455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61eaae7c-9ec2-4f7c-b652-5486ca07f3d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.813668] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61eaae7c-9ec2-4f7c-b652-5486ca07f3d6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.825642] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f59fc458-059e-4374-b3e2-7acaf6e64082: rpc.has_security_group_logging(os_id): False [ 1098.830848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.831310] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.831520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.831520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.831835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.831947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.832190] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59fc458-059e-4374-b3e2-7acaf6e64082 is going to be updated. [ 1098.834534] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ba62abf-b989-4453-9509-66329821ead3: rpc.has_security_group_logging(os_id): False [ 1098.836974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.837263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.837347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.837491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87950fcb-64a8-4442-9ae9-01d668ddee9e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.837766] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for febfb45e-9229-49aa-8dfc-5f90dbca1a4c: rpc.has_security_group_logging(os_id): False [ 1098.839203] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.839587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.839778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.839949] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.841299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.842226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.842379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.842465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e844ad3e-80cf-412c-a6ea-015ade97cb73" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.872919] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1636da8b-a16b-42d3-874d-5d8471397fd6: rpc.has_security_group_logging(os_id): False [ 1098.874622] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bc3281e-af92-4997-a592-c0e030784b0d: rpc.has_security_group_logging(os_id): False [ 1098.887634] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.887910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.887974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.888227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.888389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.897828] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.898116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.899396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.899396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.899396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.899396] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.899396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.899396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.899396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.899700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.899700] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f59fc458-059e-4374-b3e2-7acaf6e64082 is going to be updated. [ 1098.902180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.902365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.902365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.902675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.904738] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.904900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.925937] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.926212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.950775] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.950775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.954026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.954026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.973250] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1098.974889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.975299] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.975460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.975528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.975824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.975880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.976081] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ba62abf-b989-4453-9509-66329821ead3 is going to be updated. [ 1098.977628] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.977963] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.978445] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.978856] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.979131] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.979406] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 169863f3-63da-4e6e-8dbb-514951796bf8 not found, creating... [ 1098.979815] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.981081] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.981081] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.981081] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.981081] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.981719] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.982733] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.983457] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.983990] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.983990] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.985093] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 169863f3-63da-4e6e-8dbb-514951796bf8 is going to be created. [ 1098.986597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.986836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.997525] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.997700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.997826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.998031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.998240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.023192] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59fc458-059e-4374-b3e2-7acaf6e64082 in Status: IN_PROGRESS for 2s [ 1099.064128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.064556] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.064659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.064727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.065085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.065314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.065390] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c is going to be updated. [ 1099.067624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.067887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.068018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.068165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-575a9d53-3464-492c-a0bb-d9d7bb8b0eca" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.068314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.068484] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.071371] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.072256] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.072472] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.073315] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.073566] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.073818] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-169863f3-63da-4e6e-8dbb-514951796bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.086257] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.086367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.157552] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.157552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.157819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.158994] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.159128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.159188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.159397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.159487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.159705] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.159820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.159888] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.160057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.160138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.160326] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.160408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.160481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.160624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.160700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.160805] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be updated. [ 1099.161909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.162452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.221451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.221753] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.221882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.221952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.222182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.222268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.222477] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.222575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.222637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.222784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.222886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.223047] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.223127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.223181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.223315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.223389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.223480] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1099.228937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.229207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.229781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.230847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.231061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.231216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.262203] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.262344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.262408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.262621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.262769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.308465] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59fc458-059e-4374-b3e2-7acaf6e64082 in Status: IN_PROGRESS for 2s [ 1099.309668] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: IN_PROGRESS for 2s [ 1099.310180] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: IN_PROGRESS for 2s [ 1099.315486] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61eaae7c-9ec2-4f7c-b652-5486ca07f3d6 [ 1099.319023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.319023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.319023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.319023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.319023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.319023] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61eaae7c-9ec2-4f7c-b652-5486ca07f3d6 already deleted. [ 1099.319023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61eaae7c-9ec2-4f7c-b652-5486ca07f3d6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.364580] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.364785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.364785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.365179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.365339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.404349] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.404489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.404555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.404776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.404928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.417789] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: IN_PROGRESS for 2s [ 1099.427735] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1099.428208] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1099.859909] env[61538]: INFO networking_nsxv3.common.synchronization [req-d9d2c04c-8c3f-4e69-892d-3df5c6ceec85 req-6d6fef1e-3c9d-41e6-b988-6d779663007c tempest-SecurityGroupRulesNegativeTestJSON-1991323019 tempest-SecurityGroupRulesNegativeTestJSON-1991323019-project-member] Enqueued Resource ID: 0fd85c4f-f41c-441e-a98a-7c183577e765 with Priority: HIGHEST for action security_group_rules [ 1099.860755] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd85c4f-f41c-441e-a98a-7c183577e765 with Priority: HIGHEST for action security_group_rules [ 1099.861459] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fd85c4f-f41c-441e-a98a-7c183577e765 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.861459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fd85c4f-f41c-441e-a98a-7c183577e765" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.861625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fd85c4f-f41c-441e-a98a-7c183577e765" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.863119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fd85c4f-f41c-441e-a98a-7c183577e765" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.863119] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fd85c4f-f41c-441e-a98a-7c183577e765',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.974981] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1099.975271] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 1099.975453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.162131] env[61538]: INFO networking_nsxv3.common.synchronization [req-03c26346-5fbd-4bd7-b528-ec8ededfdaa5 req-7bb217fb-e173-414e-9446-feab4c0f24bc tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1100.162131] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1100.162131] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.162131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.162131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.162131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.162448] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.162534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.162852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.163200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.166182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.166292] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.374109] env[61538]: INFO networking_nsxv3.common.synchronization [req-49f0236a-1506-4ccb-9e35-dd0efef2eeb3 req-1b0e77b9-bc2c-4fc4-a98f-e59c02af92ac service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 1100.374109] env[61538]: INFO networking_nsxv3.common.synchronization [req-49f0236a-1506-4ccb-9e35-dd0efef2eeb3 req-1b0e77b9-bc2c-4fc4-a98f-e59c02af92ac service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1100.374109] env[61538]: INFO networking_nsxv3.common.synchronization [req-49f0236a-1506-4ccb-9e35-dd0efef2eeb3 req-1b0e77b9-bc2c-4fc4-a98f-e59c02af92ac service nova] Enqueued Resource ID: 169863f3-63da-4e6e-8dbb-514951796bf8 with Priority: HIGHEST for action port [ 1100.374109] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 1100.374109] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1100.374109] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 169863f3-63da-4e6e-8dbb-514951796bf8 with Priority: HIGHEST for action port [ 1100.382058] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.382058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.382058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.382058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.382058] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.382500] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.382500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.382500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.382739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.383063] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.384159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.384341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.384574] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.384640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.384899] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.386391] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-169863f3-63da-4e6e-8dbb-514951796bf8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.386608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-169863f3-63da-4e6e-8dbb-514951796bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.386703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-169863f3-63da-4e6e-8dbb-514951796bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.386984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-169863f3-63da-4e6e-8dbb-514951796bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.387066] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('169863f3-63da-4e6e-8dbb-514951796bf8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.396396] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.396396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.396396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.396396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.396396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.396396] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fd85c4f-f41c-441e-a98a-7c183577e765 already deleted. [ 1100.396396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fd85c4f-f41c-441e-a98a-7c183577e765" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.671017] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.671196] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.671289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.671508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.671602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.671804] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.671906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.671969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.672138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.672214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.672300] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1100.704502] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.704663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.704771] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.704910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.705145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.718090] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1100.890399] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.891445] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.891556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.891715] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 169863f3-63da-4e6e-8dbb-514951796bf8 with status ACTIVE [ 1100.891868] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.891976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.892052] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.892259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.892348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.892519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.892613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.892697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.892876] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.892958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.893202] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.893275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.893326] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.893423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.893493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.893575] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 169863f3-63da-4e6e-8dbb-514951796bf8 is going to be updated. [ 1100.919634] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.919794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.919841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.920053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.920181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.920331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-169863f3-63da-4e6e-8dbb-514951796bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.994200] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1100.994429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.020847] env[61538]: INFO networking_nsxv3.common.synchronization [req-38cc0d66-d625-4e2d-9495-573520d2d10a req-a7684102-a1a6-4878-8ffc-fc658e118e77 tempest-ImagesOneServerNegativeTestJSON-513524542 tempest-ImagesOneServerNegativeTestJSON-513524542-project-member] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1101.021391] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1101.021707] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.021835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.021899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.022914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.023116] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.023225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.023292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.023462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.023553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.023654] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.045920] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f59fc458-059e-4374-b3e2-7acaf6e64082 in Status: SUCCESS [ 1101.046277] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f59fc458-059e-4374-b3e2-7acaf6e64082 deletion is rescheduled due to dependency. [ 1101.046341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.060019] env[61538]: INFO networking_nsxv3.common.synchronization [req-ec7ca8ce-751d-43bb-83c0-e5d89694ae17 req-38d22921-1547-46c4-8189-80ef0a4d72f8 tempest-SecurityGroupRulesNegativeTestJSON-1991323019 tempest-SecurityGroupRulesNegativeTestJSON-1991323019-project-member] Enqueued Resource ID: 0fd85c4f-f41c-441e-a98a-7c183577e765 with Priority: HIGHEST for action security_group_rules [ 1101.060522] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd85c4f-f41c-441e-a98a-7c183577e765 with Priority: HIGHEST for action security_group_rules [ 1101.060970] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fd85c4f-f41c-441e-a98a-7c183577e765 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.061658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fd85c4f-f41c-441e-a98a-7c183577e765" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.061735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fd85c4f-f41c-441e-a98a-7c183577e765" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.061994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fd85c4f-f41c-441e-a98a-7c183577e765" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.062120] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fd85c4f-f41c-441e-a98a-7c183577e765',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.330517] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f59fc458-059e-4374-b3e2-7acaf6e64082 in Status: SUCCESS [ 1101.330689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.331441] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: SUCCESS [ 1101.331602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.335139] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: SUCCESS [ 1101.335325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.398725] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.436224] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 1101.436394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.443845] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1101.443845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.527191] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.527373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.527447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.527986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.528128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.528359] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.528498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.528571] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.528760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.528869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.529816] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be deleted. [ 1101.572849] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.573063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.573132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.575017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.575017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.575017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.606578] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.606578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.606578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.606578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.606578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.606578] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fd85c4f-f41c-441e-a98a-7c183577e765 already deleted. [ 1101.606578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fd85c4f-f41c-441e-a98a-7c183577e765" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.820318] env[61538]: INFO networking_nsxv3.common.synchronization [None req-bfb1c2bb-9fe5-435d-8e9b-127113199714 None None] Enqueued Resource ID: a13f968a-ec97-4083-a9e6-fb33f3631974 with Priority: HIGHEST for action port [ 1101.821717] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a13f968a-ec97-4083-a9e6-fb33f3631974 with Priority: HIGHEST for action port [ 1101.822711] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a13f968a-ec97-4083-a9e6-fb33f3631974 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.823722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a13f968a-ec97-4083-a9e6-fb33f3631974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.823999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a13f968a-ec97-4083-a9e6-fb33f3631974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.825865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a13f968a-ec97-4083-a9e6-fb33f3631974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.826063] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a13f968a-ec97-4083-a9e6-fb33f3631974',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.901132] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.901451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.901451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.901561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.901672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.901790] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1101.906387] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.906574] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.906839] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.907212] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.907580] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.907852] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.908013] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.908841] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.909086] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.909420] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.909631] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.909850] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.910109] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.910268] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.910392] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.910537] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.935291] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.935878] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1101.935878] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.935878] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-584" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.936318] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-6070a5d2-428a-463d-9f30-9d446eb6a23a taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.936519] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-6070a5d2-428a-463d-9f30-9d446eb6a23a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.936652] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-6070a5d2-428a-463d-9f30-9d446eb6a23a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.937017] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-6070a5d2-428a-463d-9f30-9d446eb6a23a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.937370] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6070a5d2-428a-463d-9f30-9d446eb6a23a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.939113] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.939237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.939306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.939503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.939684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.950709] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1102.329427] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a13f968a-ec97-4083-a9e6-fb33f3631974 [ 1102.329659] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.329825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.329908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.330174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.330264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.330364] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a13f968a-ec97-4083-a9e6-fb33f3631974 already deleted. [ 1102.330442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a13f968a-ec97-4083-a9e6-fb33f3631974" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.442473] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.442719] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.442853] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.443172] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.443338] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.443503] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 6070a5d2-428a-463d-9f30-9d446eb6a23a not found, creating... [ 1102.443781] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.443968] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.444123] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.445079] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.445240] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.445544] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.445712] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.445835] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.446197] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.446371] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.446521] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 6070a5d2-428a-463d-9f30-9d446eb6a23a is going to be created. [ 1102.468118] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.468352] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.468511] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.468887] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.469179] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.469447] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-6070a5d2-428a-463d-9f30-9d446eb6a23a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.565052] env[61538]: INFO networking_nsxv3.common.synchronization [req-98215a85-5321-4375-8989-49bdca58bb16 req-a8c9924d-1593-4204-9118-8c08006154f2 tempest-AttachVolumeTestJSON-1443084926 tempest-AttachVolumeTestJSON-1443084926-project-member] Enqueued Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_members [ 1102.565052] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f with Priority: HIGHEST for action security_group_members [ 1102.565052] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b226ae7-1968-4740-8cac-2825cb2bf00f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.565379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.565379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.565504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.567788] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.568033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.568033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.570092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.570092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.570092] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b226ae7-1968-4740-8cac-2825cb2bf00f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.731249] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1102.731249] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 deletion is rescheduled due to dependency. [ 1102.731670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.073082] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.073082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.073082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.073082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.096270] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.096615] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.096799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.097508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.097508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.097508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.097508] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f is going to be updated. [ 1103.131224] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.131367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.131433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.133214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.133530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.144264] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f in Status: IN_PROGRESS for 2s [ 1103.739177] env[61538]: INFO networking_nsxv3.common.synchronization [req-19a12e62-0bd3-4bfc-b1a0-4b0cface0f15 req-8d5b9b5f-a3e3-413c-a046-d0f78a45508b tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1103.741016] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1103.741016] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.741016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.741016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.741016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.741016] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.741016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.741016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.741016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.741446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.741446] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.961857] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1103.962096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.962272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.962496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.962692] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.962809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.962874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.963033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.963117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.963201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.963288] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.206545] env[61538]: INFO networking_nsxv3.common.synchronization [req-38cc0d66-d625-4e2d-9495-573520d2d10a req-48cf03e1-20aa-4f44-8784-72e2deb730e8 service nova] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_rules [ 1104.206929] env[61538]: INFO networking_nsxv3.common.synchronization [req-38cc0d66-d625-4e2d-9495-573520d2d10a req-48cf03e1-20aa-4f44-8784-72e2deb730e8 service nova] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1104.207077] env[61538]: INFO networking_nsxv3.common.synchronization [req-38cc0d66-d625-4e2d-9495-573520d2d10a req-48cf03e1-20aa-4f44-8784-72e2deb730e8 service nova] Enqueued Resource ID: 6070a5d2-428a-463d-9f30-9d446eb6a23a with Priority: HIGHEST for action port [ 1104.207786] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_rules [ 1104.207786] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1104.209921] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6070a5d2-428a-463d-9f30-9d446eb6a23a with Priority: HIGHEST for action port [ 1104.210306] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.210582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.211731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.212098] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.212215] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.217808] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.218025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.218137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.218437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.218688] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.218872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.218947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.219242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.219383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.219525] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.220809] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-6070a5d2-428a-463d-9f30-9d446eb6a23a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.220994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6070a5d2-428a-463d-9f30-9d446eb6a23a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.221124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6070a5d2-428a-463d-9f30-9d446eb6a23a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.221399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6070a5d2-428a-463d-9f30-9d446eb6a23a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.221522] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6070a5d2-428a-463d-9f30-9d446eb6a23a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.246011] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.246423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.246423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.246638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.246777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.247125] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.247247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.247329] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.247574] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.247702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.247838] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be deleted. [ 1104.284181] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.284335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.284386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.284572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.284666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.284768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.470356] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.470590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.470590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.470810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.470983] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.471102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.471165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.471316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.471409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.471499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.471644] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.471734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.471793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.471935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.472094] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.472196] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.472264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.472393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.472469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.472551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.472640] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.715956] env[61538]: INFO networking_nsxv3.common.synchronization [req-160f7e2c-b658-4a91-84a1-1f5ceacc74ab req-e8c8bc00-62b7-4846-8fe3-d0195f4897d1 tempest-InstanceActionsNegativeTestJSON-1303272001 tempest-InstanceActionsNegativeTestJSON-1303272001-project-member] Enqueued Resource ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 with Priority: HIGHEST for action security_group_members [ 1104.720024] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 with Priority: HIGHEST for action security_group_members [ 1104.720024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-41199763-c4be-4ed6-bd49-9e22e2390a80 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.720024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.720024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.720024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.720024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.720024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.720024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.720024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.720024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.720024] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41199763-c4be-4ed6-bd49-9e22e2390a80',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.727022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.727022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.727022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.727022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6070a5d2-428a-463d-9f30-9d446eb6a23a with status ACTIVE [ 1104.727022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.727022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.727022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.727022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.727022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.727022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.727022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.727022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.727022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.727022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.731026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.731188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.731260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.731459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.731547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.731695] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6070a5d2-428a-463d-9f30-9d446eb6a23a is going to be updated. [ 1104.757896] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.757896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.757896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.757896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.758245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.758379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6070a5d2-428a-463d-9f30-9d446eb6a23a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.974858] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fcbd20b-13e3-44c4-bf9a-746a1da000dc: rpc.has_security_group_logging(os_id): False [ 1104.995866] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.996094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.996094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.996340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.996436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.997771] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.997922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.997994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.998274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.998371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.998599] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.998709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.998774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.999040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.999142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.999336] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.999442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.999511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.999685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.999759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.999925] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be created. [ 1105.079140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.079140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.079140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.079140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.079444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.102595] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1105.163449] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f in Status: SUCCESS [ 1105.163710] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b226ae7-1968-4740-8cac-2825cb2bf00f deletion is rescheduled due to dependency. [ 1105.163883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b226ae7-1968-4740-8cac-2825cb2bf00f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.224283] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.224283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.224283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.224283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.235029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.245455] env[61538]: INFO networking_nsxv3.common.synchronization [req-daf527d0-852e-44cf-be10-61832fc4e854 req-570dabf2-307c-4e8b-bf3c-c0493cc8f945 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_members [ 1105.251576] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGHEST for action security_group_members [ 1105.251576] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.251576] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.251576] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.256030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.256030] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.256030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.256030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.256030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.256030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.256030] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.256030] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.256030] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.256030] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.256030] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.256030] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.256030] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.258371] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3d8835-25b4-4cc2-a332-a16e5b92a588 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.262026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.262026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.262026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.262026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.262026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.262026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.262026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.262026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.262026] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.265319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.265903] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.266284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.266444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.266719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.267334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.267966] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 is going to be updated. [ 1105.295818] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.296188] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1105.296479] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.297050] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.297603] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-55458c7f-c486-49fb-966b-0478ed8948ee taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.298108] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-55458c7f-c486-49fb-966b-0478ed8948ee" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.300364] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-55458c7f-c486-49fb-966b-0478ed8948ee" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.300364] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-55458c7f-c486-49fb-966b-0478ed8948ee" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.300364] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55458c7f-c486-49fb-966b-0478ed8948ee',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.323281] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.323281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.323281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.323281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.323281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.336044] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 in Status: IN_PROGRESS for 2s [ 1105.737057] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.737057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.737057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.737057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.737057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.737338] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be created. [ 1105.769931] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.769931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.769931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.770248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.770248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.772262] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.772541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.772541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.772842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.797339] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: UNINITIALIZED for 2s [ 1105.804510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.804840] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.806041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.806041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.806041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.806041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.806041] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 is going to be updated. [ 1105.807187] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.807328] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.807474] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.807756] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.807956] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.810313] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 55458c7f-c486-49fb-966b-0478ed8948ee not found, creating... [ 1105.810735] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.810860] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.810903] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.811241] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.811487] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.811647] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.811861] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.811932] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.812342] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.812411] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.812577] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 55458c7f-c486-49fb-966b-0478ed8948ee is going to be created. [ 1105.842400] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.842696] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.843284] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.843284] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.843656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.844069] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-55458c7f-c486-49fb-966b-0478ed8948ee" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.918690] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.918836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.918929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.919191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.919337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.930687] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 in Status: IN_PROGRESS for 2s [ 1107.121754] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1107.121754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.353955] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 in Status: SUCCESS [ 1107.353955] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41199763-c4be-4ed6-bd49-9e22e2390a80 deletion is rescheduled due to dependency. [ 1107.353955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41199763-c4be-4ed6-bd49-9e22e2390a80" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.364533] env[61538]: INFO networking_nsxv3.common.synchronization [req-19a12e62-0bd3-4bfc-b1a0-4b0cface0f15 req-b0f18969-864f-4c0e-b290-fcf5b49fccb6 service nova] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 1107.364533] env[61538]: INFO networking_nsxv3.common.synchronization [req-19a12e62-0bd3-4bfc-b1a0-4b0cface0f15 req-b0f18969-864f-4c0e-b290-fcf5b49fccb6 service nova] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1107.364533] env[61538]: INFO networking_nsxv3.common.synchronization [req-19a12e62-0bd3-4bfc-b1a0-4b0cface0f15 req-b0f18969-864f-4c0e-b290-fcf5b49fccb6 service nova] Enqueued Resource ID: 55458c7f-c486-49fb-966b-0478ed8948ee with Priority: HIGHEST for action port [ 1107.364533] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 1107.365254] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1107.365694] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55458c7f-c486-49fb-966b-0478ed8948ee with Priority: HIGHEST for action port [ 1107.366253] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.366541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.366711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.367052] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.367262] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.370022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.370022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.370022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.370022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.370022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.370022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.370022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.370022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.370022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.370770] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.372625] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-55458c7f-c486-49fb-966b-0478ed8948ee taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.374806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55458c7f-c486-49fb-966b-0478ed8948ee" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.374806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55458c7f-c486-49fb-966b-0478ed8948ee" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.374806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55458c7f-c486-49fb-966b-0478ed8948ee" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.374806] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55458c7f-c486-49fb-966b-0478ed8948ee',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.808310] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 1107.808310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.808598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.808814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.809092] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.809252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.809252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.809428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.809508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.809594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.809684] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.877949] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.879189] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.879189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.879441] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55458c7f-c486-49fb-966b-0478ed8948ee with status ACTIVE [ 1107.879441] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.879641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.879641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.879820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.879982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.880203] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.880306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.880369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.880526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.882065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.882065] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.882065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.882065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.882065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.882065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.882065] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55458c7f-c486-49fb-966b-0478ed8948ee is going to be updated. [ 1107.903712] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.904023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.904023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.904145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.904279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.904438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55458c7f-c486-49fb-966b-0478ed8948ee" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.940913] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 in Status: SUCCESS [ 1107.941375] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 deletion is rescheduled due to dependency. [ 1107.941375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.312714] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.313021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.313021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.313227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.313429] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.313534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.313599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.313791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.313894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.314039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.314242] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.314343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.314401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.314550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.314686] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.314778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.314837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.314987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.319274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.319410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.319517] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.383448] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.825507] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11ca0972-f93e-4e78-b9f2-0d09798b331c: rpc.has_security_group_logging(os_id): False [ 1108.846845] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.847068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.847138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.847355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.847453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.847666] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.847763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.847825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.847972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.848072] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.848246] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.848340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.848400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.848536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.848609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.848833] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.848940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.848940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.852356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.852500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.852563] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be created. [ 1108.885481] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.885627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.885690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.885902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.885989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.886118] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be created. [ 1108.918232] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.918470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.918554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.918712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.919223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.922700] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.922865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.922938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.923113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.923289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.934647] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: UNINITIALIZED for 2s [ 1108.944912] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: IN_PROGRESS for 2s [ 1109.174250] env[61538]: INFO networking_nsxv3.common.synchronization [None req-93627d22-f456-49b7-876b-142bb13b040c tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_rules [ 1109.174663] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_rules [ 1109.175075] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afd82025-936e-45a1-900c-5fcd4bb713ea taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.175736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.175812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.176101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.176193] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.386494] env[61538]: INFO networking_nsxv3.common.synchronization [None req-0bd9e670-8b89-4473-a18c-df82ec22156d tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_rules [ 1109.387073] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_rules [ 1109.387376] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afd82025-936e-45a1-900c-5fcd4bb713ea taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.387469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.701699] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.701869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.701944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.702176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.702292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.702360] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afd82025-936e-45a1-900c-5fcd4bb713ea already deleted. [ 1109.702527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.702587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.702797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.702876] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.232724] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.232865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.232929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.233334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.234357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.234357] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afd82025-936e-45a1-900c-5fcd4bb713ea already deleted. [ 1110.234357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.947176] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 1110.947541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.948735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.948847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.948987] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.951518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.951518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.951518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.951518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.951518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.951518] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.999032] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 1110.999032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.459467] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.962069] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 550dcd2b-7021-4904-a80d-13c93ea25fe6: rpc.has_security_group_logging(os_id): False [ 1111.989221] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.989390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.989390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.989613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.989707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.990076] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.990076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.990181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.990307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.990420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.990882] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be created. [ 1112.082019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.082214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.082265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.082494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.082704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.099910] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: IN_PROGRESS for 2s [ 1112.972149] env[61538]: INFO networking_nsxv3.common.synchronization [req-04348b26-b8b0-469a-8c35-dfbb38b75427 req-f3357c85-26e6-4fee-b26a-ca81f3b2adc9 tempest-ServerRescueNegativeTestJSON-252212181 tempest-ServerRescueNegativeTestJSON-252212181-project-member] Enqueued Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 1112.972703] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 with Priority: HIGHEST for action security_group_members [ 1112.973018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c83b44db-0e9f-4fe1-b8a5-20122469f727 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.973145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.973211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.973433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.973595] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.973694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.973916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.973916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.974069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.974403] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c83b44db-0e9f-4fe1-b8a5-20122469f727',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.994668] env[61538]: INFO networking_nsxv3.common.synchronization [req-b332c56b-c769-4614-8e17-fd33cb9e51dc req-660e1b48-f44d-4def-a53c-f3a6466f564e tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_members [ 1112.995269] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_members [ 1112.995655] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.995811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.995891] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.996811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.997064] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.997206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.997271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.997435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.997520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.997642] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.476458] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.476664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.476664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.476871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.500522] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.500522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.503216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.506064] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.509031] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 is going to be updated. [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.509031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.509031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.509924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.510223] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c already deleted. [ 1113.510543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.551175] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.551401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.551448] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.551740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.551850] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.561999] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: IN_PROGRESS for 2s [ 1113.799637] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.799637] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.799909] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.800082] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.800358] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.800567] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.800639] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.800858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.801035] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.801257] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.801377] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.801501] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.801595] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.801702] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.801808] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.801945] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.825374] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.825374] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1113.825374] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.825374] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.825374] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.825374] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.825374] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.825374] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.825374] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f18fe5c7-64c8-4f58-b7c8-806d3e03985e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.840563] env[61538]: INFO networking_nsxv3.common.synchronization [None req-92558c6a-ce19-45c9-a21a-e8324a5ca9b9 None None] Enqueued Resource ID: cfca5233-878b-462f-9cf3-99c32c3ad58c with Priority: HIGHEST for action port [ 1113.841463] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfca5233-878b-462f-9cf3-99c32c3ad58c with Priority: HIGHEST for action port [ 1113.841786] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfca5233-878b-462f-9cf3-99c32c3ad58c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.841904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfca5233-878b-462f-9cf3-99c32c3ad58c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.841966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfca5233-878b-462f-9cf3-99c32c3ad58c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.842380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfca5233-878b-462f-9cf3-99c32c3ad58c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.842483] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfca5233-878b-462f-9cf3-99c32c3ad58c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.978524] env[61538]: INFO networking_nsxv3.common.synchronization [None req-0dd5f431-1059-4d1f-b4b6-890ee33b5b8c None None] Enqueued Resource ID: d04497cb-355f-4551-980c-0c30e67ce616 with Priority: HIGHEST for action port [ 1113.978818] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d04497cb-355f-4551-980c-0c30e67ce616 with Priority: HIGHEST for action port [ 1113.979370] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d04497cb-355f-4551-980c-0c30e67ce616 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.979496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d04497cb-355f-4551-980c-0c30e67ce616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.979557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d04497cb-355f-4551-980c-0c30e67ce616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.980161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d04497cb-355f-4551-980c-0c30e67ce616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.980321] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04497cb-355f-4551-980c-0c30e67ce616',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.114391] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 1114.114391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.333159] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.333159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.333159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.333159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.333159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.333159] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port f18fe5c7-64c8-4f58-b7c8-806d3e03985e not found, creating... [ 1114.333159] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.333159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.333159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.333159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.333159] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.333836] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.333836] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.334025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.334271] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.334754] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.335169] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: f18fe5c7-64c8-4f58-b7c8-806d3e03985e is going to be created. [ 1114.346625] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfca5233-878b-462f-9cf3-99c32c3ad58c [ 1114.346625] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.346625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.347290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.347290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.347290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.347290] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfca5233-878b-462f-9cf3-99c32c3ad58c already deleted. [ 1114.347290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfca5233-878b-462f-9cf3-99c32c3ad58c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.360109] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.360440] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.360619] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.363259] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.363537] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.363787] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.483724] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d04497cb-355f-4551-980c-0c30e67ce616 [ 1114.483964] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.484123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.484195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.484416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.484859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.484859] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d04497cb-355f-4551-980c-0c30e67ce616 already deleted. [ 1114.484859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d04497cb-355f-4551-980c-0c30e67ce616" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.574091] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 in Status: SUCCESS [ 1115.574385] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c83b44db-0e9f-4fe1-b8a5-20122469f727 deletion is rescheduled due to dependency. [ 1115.574504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c83b44db-0e9f-4fe1-b8a5-20122469f727" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.773217] env[61538]: INFO networking_nsxv3.common.synchronization [req-b332c56b-c769-4614-8e17-fd33cb9e51dc req-31fc8f10-3afa-46c6-b949-ea6f000e8451 service nova] Enqueued Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_rules [ 1115.773217] env[61538]: INFO networking_nsxv3.common.synchronization [req-b332c56b-c769-4614-8e17-fd33cb9e51dc req-31fc8f10-3afa-46c6-b949-ea6f000e8451 service nova] Enqueued Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_members [ 1115.773217] env[61538]: INFO networking_nsxv3.common.synchronization [req-b332c56b-c769-4614-8e17-fd33cb9e51dc req-31fc8f10-3afa-46c6-b949-ea6f000e8451 service nova] Enqueued Resource ID: f18fe5c7-64c8-4f58-b7c8-806d3e03985e with Priority: HIGHEST for action port [ 1115.773839] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_rules [ 1115.774016] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_members [ 1115.780389] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f18fe5c7-64c8-4f58-b7c8-806d3e03985e with Priority: HIGHEST for action port [ 1115.780389] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.780389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.780389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.780389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.780389] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.780959] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.781068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.781136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.781314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.781460] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.781576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.781651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.782674] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.782958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.782958] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.783813] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.783934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.783982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.784167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.784239] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f18fe5c7-64c8-4f58-b7c8-806d3e03985e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.836184] env[61538]: INFO networking_nsxv3.common.synchronization [req-14d4cf73-cd50-4f3b-b2f8-9c43a3658516 req-9bb3f8be-e8aa-49b5-8c53-92f220265385 tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1115.836430] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1115.836862] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.837134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.837330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.837731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.837954] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.838182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.838315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.838532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.838700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.838874] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.287544] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.288725] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.288912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.289408] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f18fe5c7-64c8-4f58-b7c8-806d3e03985e with status ACTIVE [ 1116.290336] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.290336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.290336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.290336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.290336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.290336] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.291702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.291702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.291702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.291702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.291702] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.291702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.291702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.291702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.291702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.291977] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f18fe5c7-64c8-4f58-b7c8-806d3e03985e is going to be updated. [ 1116.314394] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.314567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.314693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.314934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.315090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.315311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f18fe5c7-64c8-4f58-b7c8-806d3e03985e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.344181] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.344181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.344181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.344181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.344181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.344181] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.344181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.344181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.344181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.344181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.344181] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1116.372562] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.372562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.372562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.372562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.372562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.390548] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1116.573083] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c6484ba3-2583-4600-9e41-0071a7aec530 None None] Enqueued Resource ID: 5be3a6a4-00d7-4776-8897-ac73a6e0306b with Priority: HIGHEST for action port [ 1116.574577] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be3a6a4-00d7-4776-8897-ac73a6e0306b with Priority: HIGHEST for action port [ 1116.575156] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5be3a6a4-00d7-4776-8897-ac73a6e0306b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.575307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5be3a6a4-00d7-4776-8897-ac73a6e0306b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.575381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5be3a6a4-00d7-4776-8897-ac73a6e0306b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.575657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5be3a6a4-00d7-4776-8897-ac73a6e0306b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.575763] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5be3a6a4-00d7-4776-8897-ac73a6e0306b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.735783] env[61538]: INFO networking_nsxv3.common.synchronization [req-d82ed820-6243-4a19-aae8-9c706b3e5a78 req-065ceef0-6452-4dc9-82ef-6a45054ae1e5 tempest-ImagesOneServerNegativeTestJSON-513524542 tempest-ImagesOneServerNegativeTestJSON-513524542-project-member] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1116.736389] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGHEST for action security_group_members [ 1116.736776] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.736880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.736936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.737353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.737546] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.737662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.737770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.737908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.738010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.738126] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.790415] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.078901] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5be3a6a4-00d7-4776-8897-ac73a6e0306b [ 1117.079237] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.079375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.079445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.079664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.079763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.079902] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5be3a6a4-00d7-4776-8897-ac73a6e0306b already deleted. [ 1117.079941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5be3a6a4-00d7-4776-8897-ac73a6e0306b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.116578] env[61538]: INFO networking_nsxv3.common.synchronization [None req-15b27881-17b8-4eb9-88f6-0c175ecfdfbd tempest-AttachVolumeTestJSON-1443084926 tempest-AttachVolumeTestJSON-1443084926-project-member] Enqueued Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_rules [ 1117.117225] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_rules [ 1117.117802] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b58ef26f-3838-4063-8b99-572a69b4e8cd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.117802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.117802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.118022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.118225] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.231796] env[61538]: INFO networking_nsxv3.common.synchronization [None req-3c55d847-a8cf-477b-9723-efbb5dfda3bd None None] Enqueued Resource ID: 011f972f-220e-4754-be2b-c9f946530901 with Priority: HIGHEST for action port [ 1117.232468] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 011f972f-220e-4754-be2b-c9f946530901 with Priority: HIGHEST for action port [ 1117.232790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-011f972f-220e-4754-be2b-c9f946530901 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.232916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-011f972f-220e-4754-be2b-c9f946530901" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.232983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-011f972f-220e-4754-be2b-c9f946530901" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.233802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-011f972f-220e-4754-be2b-c9f946530901" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.233927] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('011f972f-220e-4754-be2b-c9f946530901',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.240345] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.241813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.241813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.241813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.241813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.241813] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.241813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.241813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.241813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.241813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.241813] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be updated. [ 1117.277607] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.277760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.277832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.278075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.278231] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.292649] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: IN_PROGRESS for 2s [ 1117.294587] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.294852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.294852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.295049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.295148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.295293] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c is going to be created. [ 1117.326019] env[61538]: INFO networking_nsxv3.common.synchronization [None req-5c68df84-17e9-44c7-906d-3c8fb7759c59 tempest-AttachVolumeTestJSON-1443084926 tempest-AttachVolumeTestJSON-1443084926-project-member] Enqueued Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_rules [ 1117.326694] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_rules [ 1117.327273] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b58ef26f-3838-4063-8b99-572a69b4e8cd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.327354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.337589] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.337589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.337589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.337589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.337589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.350953] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c in Status: UNINITIALIZED for 2s [ 1117.650413] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.650413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.650413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.650413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.650413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.650413] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b58ef26f-3838-4063-8b99-572a69b4e8cd already deleted. [ 1117.650413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.650413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.650413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.650413] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.736681] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 011f972f-220e-4754-be2b-c9f946530901 [ 1117.740145] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.740145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.740145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.740145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.740145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.740145] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:011f972f-220e-4754-be2b-c9f946530901 already deleted. [ 1117.740145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-011f972f-220e-4754-be2b-c9f946530901" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.179238] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.179380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.179457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.179719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.179799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.179855] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b58ef26f-3838-4063-8b99-572a69b4e8cd already deleted. [ 1118.179946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.400737] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1118.400737] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 1118.401369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.204193] env[61538]: INFO networking_nsxv3.common.synchronization [req-998b7d34-2be1-4060-b111-feac0cca78a1 req-ce251f2d-c2a4-4621-9c7b-49c71ca05f59 tempest-ServersNegativeTestJSON-1742660343 tempest-ServersNegativeTestJSON-1742660343-project-member] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 1119.204730] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGHEST for action security_group_members [ 1119.205049] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.205179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.205246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.205438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.205596] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.205695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.205750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.205892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.205975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.206356] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.303734] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c in Status: SUCCESS [ 1119.303940] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c deletion is rescheduled due to dependency. [ 1119.304049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.360359] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c in Status: SUCCESS [ 1119.360574] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.360739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.360964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.361176] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.361297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.361364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.361515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.361596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.361679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.361767] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.709233] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.709412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.709643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.709718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.709777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.709980] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.710091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.710150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.710292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.710371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.710458] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be updated. [ 1119.741022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.741022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.741022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.741022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.741022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.751118] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: IN_PROGRESS for 2s [ 1119.864020] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.366487] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c: rpc.has_security_group_logging(os_id): False [ 1120.391281] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.391281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.391281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.391281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.391281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.391281] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.391281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.391281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.391281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.391281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.391281] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c is going to be created. [ 1120.460474] env[61538]: INFO networking_nsxv3.common.synchronization [None req-5c13e270-3aa6-4196-bafa-356cfc9c1260 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_rules [ 1120.461047] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_rules [ 1120.461440] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-936eb902-9d4d-4db7-a735-4f3a5141250f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.464496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.464496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.464806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.466068] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.473672] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.473838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.473895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.474402] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.474728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.489982] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c in Status: IN_PROGRESS for 2s [ 1120.570797] env[61538]: INFO networking_nsxv3.common.synchronization [None req-99ffc4c3-d17e-4aaa-b8b6-b61ae52b0b01 None None] Enqueued Resource ID: de16a220-f3f1-4474-8aba-5f6f44e7ae7b with Priority: HIGHEST for action port [ 1120.570797] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de16a220-f3f1-4474-8aba-5f6f44e7ae7b with Priority: HIGHEST for action port [ 1120.570797] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-de16a220-f3f1-4474-8aba-5f6f44e7ae7b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.570980] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de16a220-f3f1-4474-8aba-5f6f44e7ae7b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.571487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de16a220-f3f1-4474-8aba-5f6f44e7ae7b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.572816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de16a220-f3f1-4474-8aba-5f6f44e7ae7b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.572816] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de16a220-f3f1-4474-8aba-5f6f44e7ae7b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.724666] env[61538]: INFO networking_nsxv3.common.synchronization [None req-d8ffd89a-d1f9-4a46-956a-6b39990fb16f tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_rules [ 1120.725232] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_rules [ 1120.725577] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-936eb902-9d4d-4db7-a735-4f3a5141250f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.725656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.988675] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.988840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.988927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.989218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.989327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.989441] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 936eb902-9d4d-4db7-a735-4f3a5141250f already deleted. [ 1120.989551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.989705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.989898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.990014] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.075925] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de16a220-f3f1-4474-8aba-5f6f44e7ae7b [ 1121.076331] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.076519] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.078376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.078376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.078376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.078376] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de16a220-f3f1-4474-8aba-5f6f44e7ae7b already deleted. [ 1121.078376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de16a220-f3f1-4474-8aba-5f6f44e7ae7b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.516502] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.516843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.516843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.517079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.517205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.517537] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 936eb902-9d4d-4db7-a735-4f3a5141250f already deleted. [ 1121.517537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.761785] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bc3281e-af92-4997-a592-c0e030784b0d in Status: SUCCESS [ 1121.761785] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d deletion is rescheduled due to dependency. [ 1121.761785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.504185] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c in Status: SUCCESS [ 1122.504407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.615878] env[61538]: INFO networking_nsxv3.common.synchronization [req-5a958a87-db07-4acf-9018-844126d7e7ac req-3c5da66a-8526-4db5-ad0f-9ef341e29515 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_members [ 1122.615878] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_members [ 1122.615878] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-afd82025-936e-45a1-900c-5fcd4bb713ea taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.615878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.615878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.616327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.616327] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.616327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.616433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.616514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.616595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.616683] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.832021] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1aeb29b3-51ec-4924-a01e-2e2d84121940 None None] Enqueued Resource ID: 57335f52-c943-4059-8c3d-1b0ae747005a with Priority: HIGHEST for action port [ 1122.832021] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57335f52-c943-4059-8c3d-1b0ae747005a with Priority: HIGHEST for action port [ 1122.832021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-57335f52-c943-4059-8c3d-1b0ae747005a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.832021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57335f52-c943-4059-8c3d-1b0ae747005a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.832021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57335f52-c943-4059-8c3d-1b0ae747005a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.832726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57335f52-c943-4059-8c3d-1b0ae747005a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.832880] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57335f52-c943-4059-8c3d-1b0ae747005a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.121362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.121362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.121362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.121362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.121362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.121362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.121362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.121362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.121362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.121362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.123220] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afd82025-936e-45a1-900c-5fcd4bb713ea already deleted. [ 1123.123386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.251939] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.252187] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.252360] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.252591] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.252896] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.253312] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.253524] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.253763] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.253919] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.254283] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.254283] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.254387] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.254489] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.254590] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.254698] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.254835] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.278443] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.278615] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1123.278865] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.278946] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.279389] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-a89c03e7-6504-4eca-9dc3-110100bbf69c taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.279606] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-a89c03e7-6504-4eca-9dc3-110100bbf69c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.279752] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-a89c03e7-6504-4eca-9dc3-110100bbf69c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.280201] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-a89c03e7-6504-4eca-9dc3-110100bbf69c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.280336] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a89c03e7-6504-4eca-9dc3-110100bbf69c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.335072] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57335f52-c943-4059-8c3d-1b0ae747005a [ 1123.335911] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.335911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.335911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.335911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.336157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.336157] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57335f52-c943-4059-8c3d-1b0ae747005a already deleted. [ 1123.336157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57335f52-c943-4059-8c3d-1b0ae747005a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.784192] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.784590] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.784738] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.785274] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.785491] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.785855] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port a89c03e7-6504-4eca-9dc3-110100bbf69c not found, creating... [ 1123.786424] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.786662] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.787017] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.787328] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.787691] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.788263] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.788533] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.788656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.789156] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.789383] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.789555] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: a89c03e7-6504-4eca-9dc3-110100bbf69c is going to be created. [ 1123.812992] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.813247] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.813382] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.814136] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.814434] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.814696] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-a89c03e7-6504-4eca-9dc3-110100bbf69c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.331326] env[61538]: INFO networking_nsxv3.common.synchronization [None req-2f1adbbd-f26d-467f-a8e5-ee3675744df7 None None] Enqueued Resource ID: ea3aa261-f891-42e8-a0be-06cc42074e3b with Priority: HIGHEST for action port [ 1124.331956] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3aa261-f891-42e8-a0be-06cc42074e3b with Priority: HIGHEST for action port [ 1124.332133] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea3aa261-f891-42e8-a0be-06cc42074e3b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.332257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea3aa261-f891-42e8-a0be-06cc42074e3b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.332320] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea3aa261-f891-42e8-a0be-06cc42074e3b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.332568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea3aa261-f891-42e8-a0be-06cc42074e3b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.332642] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3aa261-f891-42e8-a0be-06cc42074e3b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.835073] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea3aa261-f891-42e8-a0be-06cc42074e3b [ 1124.837830] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.837830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.837830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.837830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.837830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.837830] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea3aa261-f891-42e8-a0be-06cc42074e3b already deleted. [ 1124.837830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea3aa261-f891-42e8-a0be-06cc42074e3b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.905416] env[61538]: INFO networking_nsxv3.common.synchronization [req-5a958a87-db07-4acf-9018-844126d7e7ac req-cf1094cc-5351-4905-9694-7815e9b23271 service nova] Enqueued Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_rules [ 1124.905621] env[61538]: INFO networking_nsxv3.common.synchronization [req-5a958a87-db07-4acf-9018-844126d7e7ac req-cf1094cc-5351-4905-9694-7815e9b23271 service nova] Enqueued Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_members [ 1124.905787] env[61538]: INFO networking_nsxv3.common.synchronization [req-5a958a87-db07-4acf-9018-844126d7e7ac req-cf1094cc-5351-4905-9694-7815e9b23271 service nova] Enqueued Resource ID: a89c03e7-6504-4eca-9dc3-110100bbf69c with Priority: HIGHEST for action port [ 1124.906381] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_rules [ 1124.906621] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_members [ 1124.906830] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89c03e7-6504-4eca-9dc3-110100bbf69c with Priority: HIGHEST for action port [ 1124.907599] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afd82025-936e-45a1-900c-5fcd4bb713ea taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.908584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.908584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.908746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.908842] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.909831] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-afd82025-936e-45a1-900c-5fcd4bb713ea taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.909966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.910037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.910231] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.910393] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.910486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.910549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.910691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.910908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.910908] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.911808] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a89c03e7-6504-4eca-9dc3-110100bbf69c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.911941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a89c03e7-6504-4eca-9dc3-110100bbf69c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.911991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a89c03e7-6504-4eca-9dc3-110100bbf69c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.912164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a89c03e7-6504-4eca-9dc3-110100bbf69c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.912246] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a89c03e7-6504-4eca-9dc3-110100bbf69c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.414021] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.415118] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-afd82025-936e-45a1-900c-5fcd4bb713ea taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.415250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.416393] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a89c03e7-6504-4eca-9dc3-110100bbf69c with status ACTIVE [ 1125.416393] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.416393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.416393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.416393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.416393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.416393] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.416393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.416393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.416746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.416746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.416746] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.416844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.416975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.417630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.417808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.418549] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a89c03e7-6504-4eca-9dc3-110100bbf69c is going to be updated. [ 1125.443025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.443249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.443249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.443536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.443710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.443847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a89c03e7-6504-4eca-9dc3-110100bbf69c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.919785] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.425559] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.425857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.425857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.426025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.426174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.426226] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afd82025-936e-45a1-900c-5fcd4bb713ea is going to be created. [ 1126.452808] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.452905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.452976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.453174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.453332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.467051] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afd82025-936e-45a1-900c-5fcd4bb713ea in Status: UNINITIALIZED for 2s [ 1126.957281] env[61538]: INFO networking_nsxv3.common.synchronization [None req-8cefd624-3410-4b45-aaef-6caf4092ed11 None None] Enqueued Resource ID: e85a27d9-6788-4708-ab79-d6aba152c43c with Priority: HIGHEST for action port [ 1126.957847] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e85a27d9-6788-4708-ab79-d6aba152c43c with Priority: HIGHEST for action port [ 1126.958176] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e85a27d9-6788-4708-ab79-d6aba152c43c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.958299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e85a27d9-6788-4708-ab79-d6aba152c43c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.958383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e85a27d9-6788-4708-ab79-d6aba152c43c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.958638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e85a27d9-6788-4708-ab79-d6aba152c43c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.960248] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e85a27d9-6788-4708-ab79-d6aba152c43c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.187920] env[61538]: INFO networking_nsxv3.common.synchronization [req-577994c0-728b-4795-a840-7051b9601e9d req-28429e5b-aaae-4d04-ae4b-ff4d4663cb18 tempest-AttachVolumeShelveTestJSON-1204522908 tempest-AttachVolumeShelveTestJSON-1204522908-project-member] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_members [ 1127.188475] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGHEST for action security_group_members [ 1127.188779] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.188904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.188975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.189211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.189375] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.191505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.191505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.191505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.191505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.191505] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.321755] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bc68928-0053-4d50-8719-81b626cc45fd req-959d79d0-3cb5-43d5-88b0-8b0233f59058 tempest-ServerAddressesNegativeTestJSON-735079992 tempest-ServerAddressesNegativeTestJSON-735079992-project-member] Enqueued Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGHEST for action security_group_members [ 1127.322277] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGHEST for action security_group_members [ 1127.322659] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7bff342-c2fc-4ae8-abba-46bb15d334d3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.322797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.322867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.323136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.323297] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.323407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.323491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.323647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.323733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.323849] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7bff342-c2fc-4ae8-abba-46bb15d334d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.463666] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e85a27d9-6788-4708-ab79-d6aba152c43c [ 1127.463901] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.464044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.464111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.464361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.464446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.464534] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e85a27d9-6788-4708-ab79-d6aba152c43c already deleted. [ 1127.464611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e85a27d9-6788-4708-ab79-d6aba152c43c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.695232] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.695466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.695577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.695907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.696070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.696353] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.696504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.696619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.697574] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.697574] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.697574] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ba62abf-b989-4453-9509-66329821ead3 is going to be updated. [ 1127.726522] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.726783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.727110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.727972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.727972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.736070] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: IN_PROGRESS for 2s [ 1127.830467] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.830709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.830793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.831112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.831181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.832152] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.832152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.832152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.832152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.832152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.832152] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 already deleted. [ 1127.832152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.931997] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-169 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.931997] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-169" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.931997] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-169" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.931997] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-169" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.931997] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.931997] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.931997] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.931997] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.931997] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.932549] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.932790] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.935049] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.935230] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.935363] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.935481] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.935619] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.954894] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.955144] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.955288] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.955480] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-169" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.955867] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-f890630b-67d4-4991-a8b1-b4c414add2d3 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.955983] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-f890630b-67d4-4991-a8b1-b4c414add2d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.956116] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-f890630b-67d4-4991-a8b1-b4c414add2d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.956465] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-f890630b-67d4-4991-a8b1-b4c414add2d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.956778] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f890630b-67d4-4991-a8b1-b4c414add2d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.459119] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.459482] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.459526] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.460461] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.460461] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.460461] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port f890630b-67d4-4991-a8b1-b4c414add2d3 not found, creating... [ 1128.460461] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.460647] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.460688] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.461260] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.461260] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.461364] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.461513] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.461644] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.461857] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.462853] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.462853] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: f890630b-67d4-4991-a8b1-b4c414add2d3 is going to be created. [ 1128.477990] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afd82025-936e-45a1-900c-5fcd4bb713ea in Status: SUCCESS [ 1128.477990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.477990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.477990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.478434] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.478570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.478640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.478823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.479473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.479473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.479473] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.483075] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.483075] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.483075] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.483075] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.483447] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.483447] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-f890630b-67d4-4991-a8b1-b4c414add2d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.982081] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.211425] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bc68928-0053-4d50-8719-81b626cc45fd req-048a2d9a-13cf-4a7a-ba00-9137e3bd0a52 service nova] Enqueued Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGHEST for action security_group_rules [ 1129.211614] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bc68928-0053-4d50-8719-81b626cc45fd req-048a2d9a-13cf-4a7a-ba00-9137e3bd0a52 service nova] Enqueued Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGHEST for action security_group_members [ 1129.211767] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bc68928-0053-4d50-8719-81b626cc45fd req-048a2d9a-13cf-4a7a-ba00-9137e3bd0a52 service nova] Enqueued Resource ID: f890630b-67d4-4991-a8b1-b4c414add2d3 with Priority: HIGHEST for action port [ 1129.211996] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGHEST for action security_group_rules [ 1129.212144] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGHEST for action security_group_members [ 1129.212235] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f890630b-67d4-4991-a8b1-b4c414add2d3 with Priority: HIGHEST for action port [ 1129.212767] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.212887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.212969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.216355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.216451] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7bff342-c2fc-4ae8-abba-46bb15d334d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.217282] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7bff342-c2fc-4ae8-abba-46bb15d334d3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.217400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.217466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.217647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.218139] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.218208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.218284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.218422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.218507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.218597] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7bff342-c2fc-4ae8-abba-46bb15d334d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.219381] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f890630b-67d4-4991-a8b1-b4c414add2d3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.219495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f890630b-67d4-4991-a8b1-b4c414add2d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.219538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f890630b-67d4-4991-a8b1-b4c414add2d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.219821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f890630b-67d4-4991-a8b1-b4c414add2d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.219821] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f890630b-67d4-4991-a8b1-b4c414add2d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.484240] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for afd82025-936e-45a1-900c-5fcd4bb713ea: rpc.has_security_group_logging(os_id): False [ 1129.504767] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.505054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.505194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.505537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.505691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.506105] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.506260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.506365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.506609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.506778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.506904] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afd82025-936e-45a1-900c-5fcd4bb713ea is going to be created. [ 1129.572230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.572508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.572603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.572892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.573201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.586219] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afd82025-936e-45a1-900c-5fcd4bb713ea in Status: IN_PROGRESS for 2s [ 1129.721938] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7bff342-c2fc-4ae8-abba-46bb15d334d3 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.722140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.722319] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f890630b-67d4-4991-a8b1-b4c414add2d3 with status ACTIVE [ 1129.722496] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.722609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.722709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.722879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.722969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.723153] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.723252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.723314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.723460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.723535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.723711] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.723832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.723893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.723994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.724080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.724161] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f890630b-67d4-4991-a8b1-b4c414add2d3 is going to be updated. [ 1129.725182] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7bff342-c2fc-4ae8-abba-46bb15d334d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.747880] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ba62abf-b989-4453-9509-66329821ead3 in Status: SUCCESS [ 1129.748091] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ba62abf-b989-4453-9509-66329821ead3 deletion is rescheduled due to dependency. [ 1129.748136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.750191] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.750376] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.750424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.750620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.750782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.750954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f890630b-67d4-4991-a8b1-b4c414add2d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.227333] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7bff342-c2fc-4ae8-abba-46bb15d334d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.732114] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.732379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.732379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.732560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.732654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.732749] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 is going to be created. [ 1130.758333] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.758481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.758529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.758737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.758896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.769547] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 in Status: UNINITIALIZED for 2s [ 1131.604097] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afd82025-936e-45a1-900c-5fcd4bb713ea in Status: SUCCESS [ 1131.605221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.779857] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 in Status: SUCCESS [ 1132.780179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.780653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.780653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.780748] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.780923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.780968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.781155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.781259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.781372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.781482] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7bff342-c2fc-4ae8-abba-46bb15d334d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.283561] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7bff342-c2fc-4ae8-abba-46bb15d334d3 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.283733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.283825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.284024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.284213] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.284320] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.284370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.284530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.284614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.284705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.284851] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7bff342-c2fc-4ae8-abba-46bb15d334d3 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.284941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.284998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.285157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.285304] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.285397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.285456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.285615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.285673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.285735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.285823] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7bff342-c2fc-4ae8-abba-46bb15d334d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.788299] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7bff342-c2fc-4ae8-abba-46bb15d334d3: rpc.has_security_group_logging(os_id): False [ 1133.807231] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.807394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.807463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.807638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.807816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.807939] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.808062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.808162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.808330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.808415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.809634] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.809634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.810247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.810247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.810319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.810601] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.810601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.810709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.810817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.811040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.811040] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 is going to be created. [ 1133.880321] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.880507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.880586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.880803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.880983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.892847] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 in Status: IN_PROGRESS for 2s [ 1134.213769] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1134.213906] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1135.905957] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 in Status: SUCCESS [ 1135.906346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.832431] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-8b769aec-1d46-481e-a5b2-2d00a56d727d tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1137.832915] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1137.833236] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.833389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.833488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.833747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.833918] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.834036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.834100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.834258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.834345] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.834435] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.336146] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.336311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.336385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.336620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.339199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.339199] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.339199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.339199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.339199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.339199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.339199] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 already deleted. [ 1138.339199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.460125] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-37553ea3-68e6-4656-9068-0d16e079d93c tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1138.460731] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1138.464447] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.464613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.464695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.464898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.465094] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.465386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.465386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.465542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.465542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.465629] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.968507] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.968507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.968507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.968507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.968841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.968841] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.968841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.968947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.969101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.969236] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.969296] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 already deleted. [ 1138.969411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.010565] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-ca24e1a7-a9cd-449b-a86d-505d8ad38225 tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1139.011044] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1139.011349] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.011474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.011539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.011747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.011906] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.012011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.012075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.012217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.012303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.012393] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.276820] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.277036] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.277166] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.277532] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.277819] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.277988] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.278126] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.278354] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.278502] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.278719] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.278834] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.278945] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.279096] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.279209] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.279375] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.279546] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.306509] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.306509] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.306681] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.306829] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.307099] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.307275] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.307406] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.308048] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.308048] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.516082] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.516082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.516082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.516082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.516082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.516082] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.516082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.516082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.516082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.516423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.516423] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 already deleted. [ 1139.516423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.814971] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.814971] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.814971] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.814971] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.814971] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.814971] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91 not found, creating... [ 1139.814971] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.814971] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.815319] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.815319] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.815604] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.816175] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.816175] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.816857] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.817147] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.817501] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.817742] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91 is going to be created. [ 1139.844047] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.844047] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.844557] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.844637] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.844942] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.845656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.300446] env[61538]: INFO networking_nsxv3.common.synchronization [req-cff2dc68-4c65-4144-baaf-dcff358481b6 req-19df2f39-9451-4c1e-9b3d-4b6dad1cf106 tempest-AttachVolumeTestJSON-1443084926 tempest-AttachVolumeTestJSON-1443084926-project-member] Enqueued Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_members [ 1140.301224] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_members [ 1140.301412] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b58ef26f-3838-4063-8b99-572a69b4e8cd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.301542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.301609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.301867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.302168] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.302321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.302435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.302679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.302804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.302923] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.805341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.805555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.805599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.805808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.805901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.806116] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.806214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.806277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.806435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.806513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.806606] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b58ef26f-3838-4063-8b99-572a69b4e8cd already deleted. [ 1140.806686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.912704] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-bb588bdc-8291-4a42-b95a-b561df497f73 service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1140.912890] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-bb588bdc-8291-4a42-b95a-b561df497f73 service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1140.913051] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-bb588bdc-8291-4a42-b95a-b561df497f73 service nova] Enqueued Resource ID: cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91 with Priority: HIGHEST for action port [ 1140.913572] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1140.913710] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1140.913809] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91 with Priority: HIGHEST for action port [ 1140.914131] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.914298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.914369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.914743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.914833] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.915679] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.919022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.919022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.919022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.919022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.988033] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.988033] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-279" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.988241] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-279" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.988369] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-279" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.989112] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.989112] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.989112] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.989297] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.989428] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.989672] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.989784] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.989905] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.990012] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.990126] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.990234] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.990390] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.011603] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.011603] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1141.011603] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.011855] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-279" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.012238] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-39d2066d-48ee-40bd-bb98-733c92c48910 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.012415] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-39d2066d-48ee-40bd-bb98-733c92c48910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.013013] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-39d2066d-48ee-40bd-bb98-733c92c48910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.013013] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-39d2066d-48ee-40bd-bb98-733c92c48910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.013013] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39d2066d-48ee-40bd-bb98-733c92c48910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.045385] env[61538]: INFO networking_nsxv3.common.synchronization [req-a24d8861-17f4-4856-97e9-7861c0324ccb req-4e67b1dc-f853-4480-9b83-b095d83d068d tempest-ServerAddressesNegativeTestJSON-735079992 tempest-ServerAddressesNegativeTestJSON-735079992-project-member] Enqueued Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGHEST for action security_group_members [ 1141.045598] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGHEST for action security_group_members [ 1141.046437] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7bff342-c2fc-4ae8-abba-46bb15d334d3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.046437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.046437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.046594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.046774] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.046774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.046862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.046981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.047068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.047159] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7bff342-c2fc-4ae8-abba-46bb15d334d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.419204] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.420314] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.420441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.420647] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91 with status ACTIVE [ 1141.420817] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.420922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.420987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.425010] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.425010] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.425010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.425010] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91 is going to be updated. [ 1141.443588] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.443810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.443931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.444461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.444696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.444936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbeccc2f-cfc6-4e1e-8f7b-d7883e01be91" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.516222] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.516479] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.516617] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.516901] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.517068] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.517228] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 39d2066d-48ee-40bd-bb98-733c92c48910 not found, creating... [ 1141.517999] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.517999] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.518168] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.518370] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.518519] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.518815] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.518965] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.519103] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.519321] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.519537] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.519693] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 39d2066d-48ee-40bd-bb98-733c92c48910 is going to be created. [ 1141.550212] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.550470] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.550619] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.550953] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.551162] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.551395] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-39d2066d-48ee-40bd-bb98-733c92c48910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.552539] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.552721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.552834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.553569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.553569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.553569] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.553883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.553883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.554075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.554206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.554358] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 is going to be updated. [ 1141.588655] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.588799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.588875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.589124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.589270] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.602411] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 in Status: IN_PROGRESS for 2s [ 1141.751994] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.752364] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-421" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.752460] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-421" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.752919] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-421" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.753388] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.753872] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.753872] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.754343] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.754602] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.754976] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.755207] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.755413] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.756035] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.756655] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.756966] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.757307] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.784272] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.784492] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1141.784670] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.784889] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-421" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.785375] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-98be7dc1-d53f-476a-8f23-de85f656f6b2 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.785759] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-98be7dc1-d53f-476a-8f23-de85f656f6b2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.785759] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-98be7dc1-d53f-476a-8f23-de85f656f6b2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.786173] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-98be7dc1-d53f-476a-8f23-de85f656f6b2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.786317] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98be7dc1-d53f-476a-8f23-de85f656f6b2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.924697] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.292594] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.292854] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.292980] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.293295] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.293459] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.293626] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 98be7dc1-d53f-476a-8f23-de85f656f6b2 not found, creating... [ 1142.293897] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.294076] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.294202] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.294619] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.294619] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.294851] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.295023] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.295147] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.295361] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.295505] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.295662] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 98be7dc1-d53f-476a-8f23-de85f656f6b2 is going to be created. [ 1142.316725] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.316944] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.317083] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.317489] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.317748] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.317977] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-98be7dc1-d53f-476a-8f23-de85f656f6b2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.390630] env[61538]: INFO networking_nsxv3.common.synchronization [req-cff2dc68-4c65-4144-baaf-dcff358481b6 req-be444732-a412-4eb8-bd37-f0769213e332 service nova] Enqueued Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_rules [ 1142.390630] env[61538]: INFO networking_nsxv3.common.synchronization [req-cff2dc68-4c65-4144-baaf-dcff358481b6 req-be444732-a412-4eb8-bd37-f0769213e332 service nova] Enqueued Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_members [ 1142.390630] env[61538]: INFO networking_nsxv3.common.synchronization [req-cff2dc68-4c65-4144-baaf-dcff358481b6 req-be444732-a412-4eb8-bd37-f0769213e332 service nova] Enqueued Resource ID: 39d2066d-48ee-40bd-bb98-733c92c48910 with Priority: HIGHEST for action port [ 1142.391064] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_rules [ 1142.391195] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_members [ 1142.391287] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d2066d-48ee-40bd-bb98-733c92c48910 with Priority: HIGHEST for action port [ 1142.391554] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b58ef26f-3838-4063-8b99-572a69b4e8cd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.391700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.391760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.391968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.392186] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.393041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b58ef26f-3838-4063-8b99-572a69b4e8cd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.396374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.396374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.396374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.396374] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.396374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.396374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.396374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.396374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.396374] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.398077] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-39d2066d-48ee-40bd-bb98-733c92c48910 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.398077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39d2066d-48ee-40bd-bb98-733c92c48910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.398077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39d2066d-48ee-40bd-bb98-733c92c48910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.398566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39d2066d-48ee-40bd-bb98-733c92c48910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.398566] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39d2066d-48ee-40bd-bb98-733c92c48910',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.427542] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.427878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.427878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.428028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.428085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.428197] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be created. [ 1142.469404] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.469404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.469404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.469404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.469404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.478600] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: UNINITIALIZED for 2s [ 1142.635472] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bd11ab6-fd43-4313-8f30-757835d96f66 req-1316c272-2291-4d83-a7e6-4525628751d5 tempest-ServerTagsTestJSON-1274712918 tempest-ServerTagsTestJSON-1274712918-project-member] Enqueued Resource ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 with Priority: HIGHEST for action security_group_members [ 1142.635472] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 with Priority: HIGHEST for action security_group_members [ 1142.636143] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc4f43e-d331-4f7a-8140-5609ba8b2867 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.637116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.637255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.637531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.637711] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.637846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.637941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.638042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.638232] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.638232] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc4f43e-d331-4f7a-8140-5609ba8b2867',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.900624] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.900624] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b58ef26f-3838-4063-8b99-572a69b4e8cd taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.900624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.902125] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39d2066d-48ee-40bd-bb98-733c92c48910 with status ACTIVE [ 1142.902543] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.903382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.903596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.904184] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.906775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.906775] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.906775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.906775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.906775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.906775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.906775] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.906775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.906775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.906775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.906775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.906775] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39d2066d-48ee-40bd-bb98-733c92c48910 is going to be updated. [ 1142.929284] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.929284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.929284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.930622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.930809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.931063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39d2066d-48ee-40bd-bb98-733c92c48910" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.140996] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.141323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.141390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.141648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.141751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.141952] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.142074] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.142137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.142303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.142362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.142451] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 already deleted. [ 1143.142525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.403215] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.421753] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.422408] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-821" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.422408] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-821" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.422523] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-821" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.422705] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.422937] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.422995] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.423564] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.423786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.424061] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.424241] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.424439] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.424634] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.424853] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.425071] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.425383] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.444784] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.445070] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1143.445152] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.445282] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-821" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.445587] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-042733f1-0011-46e6-b88b-bc359a44bca2 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.445759] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-042733f1-0011-46e6-b88b-bc359a44bca2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.445899] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-042733f1-0011-46e6-b88b-bc359a44bca2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.447697] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-042733f1-0011-46e6-b88b-bc359a44bca2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.447697] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('042733f1-0011-46e6-b88b-bc359a44bca2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.473949] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-eaa97648-c59d-4a31-bcfb-c5f2803784dd service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1143.474161] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-eaa97648-c59d-4a31-bcfb-c5f2803784dd service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1143.474308] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-eaa97648-c59d-4a31-bcfb-c5f2803784dd service nova] Enqueued Resource ID: 98be7dc1-d53f-476a-8f23-de85f656f6b2 with Priority: HIGHEST for action port [ 1143.474904] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1143.476352] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1143.476542] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98be7dc1-d53f-476a-8f23-de85f656f6b2 with Priority: HIGHEST for action port [ 1143.476871] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.477086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.477362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.477525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.477766] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-98be7dc1-d53f-476a-8f23-de85f656f6b2 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.477919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98be7dc1-d53f-476a-8f23-de85f656f6b2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.478036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98be7dc1-d53f-476a-8f23-de85f656f6b2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.478291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98be7dc1-d53f-476a-8f23-de85f656f6b2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.478435] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98be7dc1-d53f-476a-8f23-de85f656f6b2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.616854] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 in Status: SUCCESS [ 1143.617046] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 deletion is rescheduled due to dependency. [ 1143.617168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.905544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.905707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.905831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.906093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.906209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.906316] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b58ef26f-3838-4063-8b99-572a69b4e8cd is going to be created. [ 1143.930415] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.930622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.930622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.930817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.930984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.941503] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b58ef26f-3838-4063-8b99-572a69b4e8cd in Status: UNINITIALIZED for 2s [ 1143.949621] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.949877] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.950062] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.950439] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.950647] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.950843] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 042733f1-0011-46e6-b88b-bc359a44bca2 not found, creating... [ 1143.951136] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.951300] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.951422] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.951652] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.951797] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.952104] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.952299] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.952414] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.952671] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.952815] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.952959] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 042733f1-0011-46e6-b88b-bc359a44bca2 is going to be created. [ 1143.974105] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.974389] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.974457] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.974732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.974966] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.975210] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-042733f1-0011-46e6-b88b-bc359a44bca2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.980801] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98be7dc1-d53f-476a-8f23-de85f656f6b2 with status ACTIVE [ 1143.980997] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.981134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.981199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.981390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.981547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.981723] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.981828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.981879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.982045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.982128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.982311] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.982405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.982464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.982604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.982667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.982753] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98be7dc1-d53f-476a-8f23-de85f656f6b2 is going to be updated. [ 1144.008740] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.008910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.008952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.009172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.009313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.009570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98be7dc1-d53f-476a-8f23-de85f656f6b2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.338175] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.338393] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.338599] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.338805] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.339652] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.339851] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.340022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.340339] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.340530] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.340755] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.340921] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.340988] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.341115] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.341232] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.341343] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.341496] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.363459] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.363685] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1144.363811] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.363997] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-84" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.364773] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.364773] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.364773] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.365040] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.365186] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dcaf9ff-4661-4e01-8e12-31e081cb7c9a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.490778] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1144.491182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.491182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.491403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.491727] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.491838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.491930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.492154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.492272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.492338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.492445] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.494180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.494381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.494596] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.494855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.494952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.495155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.495280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.495457] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.821342] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bd11ab6-fd43-4313-8f30-757835d96f66 req-dabcaa42-39e5-43e8-aaff-1d2b629d7b81 service nova] Enqueued Resource ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 with Priority: HIGHEST for action security_group_rules [ 1144.821558] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bd11ab6-fd43-4313-8f30-757835d96f66 req-dabcaa42-39e5-43e8-aaff-1d2b629d7b81 service nova] Enqueued Resource ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 with Priority: HIGHEST for action security_group_members [ 1144.821760] env[61538]: INFO networking_nsxv3.common.synchronization [req-9bd11ab6-fd43-4313-8f30-757835d96f66 req-dabcaa42-39e5-43e8-aaff-1d2b629d7b81 service nova] Enqueued Resource ID: 042733f1-0011-46e6-b88b-bc359a44bca2 with Priority: HIGHEST for action port [ 1144.822010] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 with Priority: HIGHEST for action security_group_rules [ 1144.822149] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 with Priority: HIGHEST for action security_group_members [ 1144.822246] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042733f1-0011-46e6-b88b-bc359a44bca2 with Priority: HIGHEST for action port [ 1144.823491] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc4f43e-d331-4f7a-8140-5609ba8b2867 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.823491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.823491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.824300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.824300] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc4f43e-d331-4f7a-8140-5609ba8b2867',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.825049] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc4f43e-d331-4f7a-8140-5609ba8b2867 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.825170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.825238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.825408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.825559] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.825654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.825715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.825852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.825941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.826040] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc4f43e-d331-4f7a-8140-5609ba8b2867',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.827217] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-042733f1-0011-46e6-b88b-bc359a44bca2 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.827330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-042733f1-0011-46e6-b88b-bc359a44bca2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.827398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-042733f1-0011-46e6-b88b-bc359a44bca2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.827659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-042733f1-0011-46e6-b88b-bc359a44bca2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.827742] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('042733f1-0011-46e6-b88b-bc359a44bca2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.868544] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.868544] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.868795] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.868932] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.869277] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.869632] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 9dcaf9ff-4661-4e01-8e12-31e081cb7c9a not found, creating... [ 1144.870091] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.870381] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.874028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.874028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.874028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.874028] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.874028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.874028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.874028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.874028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.874028] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 9dcaf9ff-4661-4e01-8e12-31e081cb7c9a is going to be created. [ 1144.900329] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.900611] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.900744] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.901069] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.901317] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.901562] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.995592] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.995592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.997354] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.185180] env[61538]: INFO networking_nsxv3.common.synchronization [None req-8eaa8ab4-d5fa-4d9e-96f0-d85893b46097 tempest-AttachVolumeShelveTestJSON-1204522908 tempest-AttachVolumeShelveTestJSON-1204522908-project-member] Enqueued Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_rules [ 1145.187741] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_rules [ 1145.187741] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.187741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.187741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.187741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.187741] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.326186] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc4f43e-d331-4f7a-8140-5609ba8b2867 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.326397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.328925] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbc4f43e-d331-4f7a-8140-5609ba8b2867',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.333047] env[61538]: INFO networking_nsxv3.common.synchronization [req-e73b142c-ce95-48cb-a3c4-30cfe0177e19 req-2c769188-f855-4484-a200-20287ee7c1f0 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_members [ 1145.333047] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 042733f1-0011-46e6-b88b-bc359a44bca2 with status ACTIVE [ 1145.333047] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.333047] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.333047] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.333047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.333965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.333965] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 042733f1-0011-46e6-b88b-bc359a44bca2 is going to be updated. [ 1145.337024] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_members [ 1145.337024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-936eb902-9d4d-4db7-a735-4f3a5141250f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.337024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.337024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.337024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.337024] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.337024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.337024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.337024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.337024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.337024] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.359402] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.359560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.359594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.359774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.359913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.360089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-042733f1-0011-46e6-b88b-bc359a44bca2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.416951] env[61538]: INFO networking_nsxv3.common.synchronization [None req-edbe2ca6-43c3-46e2-a5d3-b777a4e37644 tempest-AttachVolumeShelveTestJSON-1204522908 tempest-AttachVolumeShelveTestJSON-1204522908-project-member] Enqueued Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_rules [ 1145.417695] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_rules [ 1145.418011] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.418331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.500239] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.709535] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.709714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.709777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.709993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.710116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.710218] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6585f491-6358-4615-a571-0639903266ae already deleted. [ 1145.710303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.710506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.710734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.710828] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.831064] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbc4f43e-d331-4f7a-8140-5609ba8b2867',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.838512] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.838647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.838647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.838874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.838987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.839837] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.839837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.839837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.839837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.839837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.839837] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 936eb902-9d4d-4db7-a735-4f3a5141250f already deleted. [ 1145.840086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.961080] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b58ef26f-3838-4063-8b99-572a69b4e8cd in Status: SUCCESS [ 1145.961262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.961833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.961833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.961833] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.961993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.961993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.962161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.962238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.962958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.962958] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.005553] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.005553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.005553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.005553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.005553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.005553] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1146.040859] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.041047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.041493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.041493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.041582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.051552] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1146.235503] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.235732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.235732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.235913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.236010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.236112] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6585f491-6358-4615-a571-0639903266ae already deleted. [ 1146.236210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.335291] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.335451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.335516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.335746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.335827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.335922] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 is going to be created. [ 1146.368818] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.368905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.368942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.369175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.369336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.386776] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 in Status: UNINITIALIZED for 2s [ 1146.464439] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.660231] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-a70bdbfb-48bd-4146-8759-61b4aa22dbf2 service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1146.660595] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-a70bdbfb-48bd-4146-8759-61b4aa22dbf2 service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1146.660595] env[61538]: INFO networking_nsxv3.common.synchronization [req-03e44b77-8d98-4b94-a2fa-29077bd2efab req-a70bdbfb-48bd-4146-8759-61b4aa22dbf2 service nova] Enqueued Resource ID: 9dcaf9ff-4661-4e01-8e12-31e081cb7c9a with Priority: HIGHEST for action port [ 1146.661189] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1146.661334] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1146.661430] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dcaf9ff-4661-4e01-8e12-31e081cb7c9a with Priority: HIGHEST for action port [ 1146.661710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.661831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.662067] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.662169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.662372] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.662530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.662530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.662733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.662845] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dcaf9ff-4661-4e01-8e12-31e081cb7c9a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.765332] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.765557] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.765700] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.766011] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.766330] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.766514] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.766670] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.766933] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.767119] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.767386] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.767592] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.767724] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.767860] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.767990] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.768133] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.768290] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.789648] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.789975] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1146.790210] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.790469] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.790932] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-c279f08f-d443-4a8b-bd37-296ed181c6a7 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.791230] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-c279f08f-d443-4a8b-bd37-296ed181c6a7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.791547] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-c279f08f-d443-4a8b-bd37-296ed181c6a7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.791845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-c279f08f-d443-4a8b-bd37-296ed181c6a7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.792020] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c279f08f-d443-4a8b-bd37-296ed181c6a7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.970037] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b58ef26f-3838-4063-8b99-572a69b4e8cd: rpc.has_security_group_logging(os_id): False [ 1146.988916] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.989215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.989309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.990173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.990285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.990610] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.990758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.990809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.991035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.991157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.991257] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b58ef26f-3838-4063-8b99-572a69b4e8cd is going to be created. [ 1147.068431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.068608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.068765] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.068904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.069099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.082153] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b58ef26f-3838-4063-8b99-572a69b4e8cd in Status: IN_PROGRESS for 2s [ 1147.165081] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dcaf9ff-4661-4e01-8e12-31e081cb7c9a with status ACTIVE [ 1147.165569] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.165669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.165773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.166024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.166183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.166402] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.166550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.166626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.166805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.166885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.167415] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.167415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.167415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.167415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.167613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.167613] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dcaf9ff-4661-4e01-8e12-31e081cb7c9a is going to be updated. [ 1147.206894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.207126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.207126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.207324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.207503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.207674] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dcaf9ff-4661-4e01-8e12-31e081cb7c9a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.296748] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.297069] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.297191] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.297514] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.297669] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.297834] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port c279f08f-d443-4a8b-bd37-296ed181c6a7 not found, creating... [ 1147.298136] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.298306] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.298430] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.298695] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.298854] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.299222] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.299415] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.299532] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.300214] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.300214] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.300214] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: c279f08f-d443-4a8b-bd37-296ed181c6a7 is going to be created. [ 1147.331487] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.331487] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.331487] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.331487] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.331487] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.331831] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-c279f08f-d443-4a8b-bd37-296ed181c6a7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.066161] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1148.066384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.066384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.066691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.066881] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.066992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.067064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.067215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.067293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.067390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.067578] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.067663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.067719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.067855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.067984] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.068319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.068381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.068524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.068611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.068669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.068750] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.070232] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.070608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.070766] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.070864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.070925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.071090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.071165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.071250] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.398570] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 in Status: SUCCESS [ 1148.398791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.398953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.399188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.399382] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.399523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.399626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.399849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.399941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.400043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.400133] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbc4f43e-d331-4f7a-8140-5609ba8b2867',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.571533] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d975b5-946d-46cc-a181-419245c51c87: rpc.has_security_group_logging(os_id): False [ 1148.572777] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.592148] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.592374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.592374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.592555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.592687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.592893] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.592999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.593077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.593226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.593304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.593480] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.593575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.593635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.593770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.593842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.594037] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.594143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.594204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.594341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.594416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.594503] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be created. [ 1148.672290] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.672290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.672290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.672290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.672290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.684276] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1148.808341] env[61538]: INFO networking_nsxv3.common.synchronization [req-e73b142c-ce95-48cb-a3c4-30cfe0177e19 req-5fe27623-6f17-4df4-ad15-4219f6a7c467 service nova] Enqueued Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_rules [ 1148.808606] env[61538]: INFO networking_nsxv3.common.synchronization [req-e73b142c-ce95-48cb-a3c4-30cfe0177e19 req-5fe27623-6f17-4df4-ad15-4219f6a7c467 service nova] Enqueued Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_members [ 1148.809424] env[61538]: INFO networking_nsxv3.common.synchronization [req-e73b142c-ce95-48cb-a3c4-30cfe0177e19 req-5fe27623-6f17-4df4-ad15-4219f6a7c467 service nova] Enqueued Resource ID: c279f08f-d443-4a8b-bd37-296ed181c6a7 with Priority: HIGHEST for action port [ 1148.809750] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_rules [ 1148.809913] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_members [ 1148.810033] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c279f08f-d443-4a8b-bd37-296ed181c6a7 with Priority: HIGHEST for action port [ 1148.810337] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-936eb902-9d4d-4db7-a735-4f3a5141250f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.810487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.812437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.812437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.812437] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.812866] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-936eb902-9d4d-4db7-a735-4f3a5141250f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.813180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.813285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.813545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.813752] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.813865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.813932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.814146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.814239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.814371] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.815790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-c279f08f-d443-4a8b-bd37-296ed181c6a7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.816085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c279f08f-d443-4a8b-bd37-296ed181c6a7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.816180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c279f08f-d443-4a8b-bd37-296ed181c6a7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.816366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c279f08f-d443-4a8b-bd37-296ed181c6a7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.816466] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c279f08f-d443-4a8b-bd37-296ed181c6a7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.857164] env[61538]: INFO networking_nsxv3.common.synchronization [req-c421d6a3-3111-4833-b9bd-2eac592a4823 req-89ca2d5a-67f6-4aa8-bc6a-43c7c684ed03 tempest-ServerGroupTestJSON-1228520834 tempest-ServerGroupTestJSON-1228520834-project-member] Enqueued Resource ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d with Priority: HIGHEST for action security_group_members [ 1148.857164] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d with Priority: HIGHEST for action security_group_members [ 1148.857164] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-505279a2-0eaf-42f5-83ce-248a1f6eec1d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.857164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.857164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.857164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.857164] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.857164] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.859706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.860049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.860238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.860454] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('505279a2-0eaf-42f5-83ce-248a1f6eec1d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.905581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc4f43e-d331-4f7a-8140-5609ba8b2867 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.905581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.905581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc4f43e-d331-4f7a-8140-5609ba8b2867 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.905581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.905581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.906268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.906268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.906268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.906268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.906268] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbc4f43e-d331-4f7a-8140-5609ba8b2867',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.076877] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.095434] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b58ef26f-3838-4063-8b99-572a69b4e8cd in Status: SUCCESS [ 1149.095771] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.313930] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-936eb902-9d4d-4db7-a735-4f3a5141250f taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.314076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.316477] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.318152] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c279f08f-d443-4a8b-bd37-296ed181c6a7 with status ACTIVE [ 1149.318348] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.322020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.322020] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.322020] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.322020] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c279f08f-d443-4a8b-bd37-296ed181c6a7 is going to be updated. [ 1149.342505] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.342919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.342919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.343055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.343103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.343264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c279f08f-d443-4a8b-bd37-296ed181c6a7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.363181] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.363181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.363354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.363461] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.363566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.363751] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.363875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.363972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.364160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.364238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.364329] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d already deleted. [ 1149.364409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.380806] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-143 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.381039] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-143" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.381169] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-143" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.381567] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-143" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.385140] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.385424] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.385759] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.387430] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.387430] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.387430] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.387430] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.387430] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.387430] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.387430] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.387817] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.388067] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.408638] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbc4f43e-d331-4f7a-8140-5609ba8b2867: rpc.has_security_group_logging(os_id): False [ 1149.436926] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.436926] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1149.436926] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.436926] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-143" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.436926] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-750ea46d-7298-43ac-a56d-08093fc56a42 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.436926] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-750ea46d-7298-43ac-a56d-08093fc56a42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.436926] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-750ea46d-7298-43ac-a56d-08093fc56a42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.437736] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-750ea46d-7298-43ac-a56d-08093fc56a42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.437736] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('750ea46d-7298-43ac-a56d-08093fc56a42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.442677] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.442936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.442936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.443216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.443355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.443675] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.443821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.443895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.444091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.444170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.444379] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.444470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.444530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.444679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.444743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.448032] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.448032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.448032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.448032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.448032] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.448032] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 is going to be created. [ 1149.531088] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.531245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.531313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.531531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.531717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.544326] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 in Status: IN_PROGRESS for 2s [ 1149.581080] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.581242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.581318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.581543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.581641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.581771] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1149.632984] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.633281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.633414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.633818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.634051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.647282] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1149.818461] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.940218] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.940530] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.940682] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.941070] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.941271] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.941443] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 750ea46d-7298-43ac-a56d-08093fc56a42 not found, creating... [ 1149.941738] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.941920] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.942029] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.942324] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.942480] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.942826] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.943025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.943152] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.943389] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.944105] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.944292] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 750ea46d-7298-43ac-a56d-08093fc56a42 is going to be created. [ 1149.970901] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.975122] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.975570] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.975884] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.976240] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.976825] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-750ea46d-7298-43ac-a56d-08093fc56a42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.985755] env[61538]: INFO networking_nsxv3.common.synchronization [req-7dab3236-4f9b-449f-b218-9bcbb2cc2428 req-21fe2b5e-69bf-4b49-8052-cd36f466e852 tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1149.986418] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1149.986747] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.987359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.987474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.987705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.987936] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.988063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.988133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.988327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.988418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.988521] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.321245] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.321693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.321693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.321693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.321803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.321892] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 936eb902-9d4d-4db7-a735-4f3a5141250f is going to be created. [ 1150.348416] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.348637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.348637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.348828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.348985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.359151] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 936eb902-9d4d-4db7-a735-4f3a5141250f in Status: UNINITIALIZED for 2s [ 1150.494523] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.494697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.494766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.494976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.495078] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.495274] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.495368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.495428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.495608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.495682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.495765] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1150.524910] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.525112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.525198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.525456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.525915] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.538453] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1150.702282] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1150.702558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.702770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.703015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.703122] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.193055] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.193285] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.193417] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.193706] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.193972] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.195110] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.195110] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.195821] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.196369] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.196685] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1151.196937] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.197187] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.197349] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.197598] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1151.198934] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.199134] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.206321] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.208865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.219757] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.219757] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1151.219994] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.220230] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.220412] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-7a524b94-5ca7-497a-8066-258b28fe2992 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.220610] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-7a524b94-5ca7-497a-8066-258b28fe2992" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.220740] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-7a524b94-5ca7-497a-8066-258b28fe2992" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.221640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-7a524b94-5ca7-497a-8066-258b28fe2992" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.221853] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a524b94-5ca7-497a-8066-258b28fe2992',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.346227] env[61538]: INFO networking_nsxv3.common.synchronization [req-c421d6a3-3111-4833-b9bd-2eac592a4823 req-26c7a677-6d96-44d6-97c1-9de9db1de41f service nova] Enqueued Resource ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d with Priority: HIGHEST for action security_group_rules [ 1151.346227] env[61538]: INFO networking_nsxv3.common.synchronization [req-c421d6a3-3111-4833-b9bd-2eac592a4823 req-26c7a677-6d96-44d6-97c1-9de9db1de41f service nova] Enqueued Resource ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d with Priority: HIGHEST for action security_group_members [ 1151.346227] env[61538]: INFO networking_nsxv3.common.synchronization [req-c421d6a3-3111-4833-b9bd-2eac592a4823 req-26c7a677-6d96-44d6-97c1-9de9db1de41f service nova] Enqueued Resource ID: 750ea46d-7298-43ac-a56d-08093fc56a42 with Priority: HIGHEST for action port [ 1151.346227] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d with Priority: HIGHEST for action security_group_rules [ 1151.346227] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d with Priority: HIGHEST for action security_group_members [ 1151.346227] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750ea46d-7298-43ac-a56d-08093fc56a42 with Priority: HIGHEST for action port [ 1151.347581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-505279a2-0eaf-42f5-83ce-248a1f6eec1d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.347978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.348163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.348507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.348691] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('505279a2-0eaf-42f5-83ce-248a1f6eec1d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.350080] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-505279a2-0eaf-42f5-83ce-248a1f6eec1d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.350407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.350631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.351146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.355022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.355022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.355022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.355022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.355022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.355022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('505279a2-0eaf-42f5-83ce-248a1f6eec1d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.355022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-750ea46d-7298-43ac-a56d-08093fc56a42 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.355022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-750ea46d-7298-43ac-a56d-08093fc56a42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.355022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-750ea46d-7298-43ac-a56d-08093fc56a42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.355022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-750ea46d-7298-43ac-a56d-08093fc56a42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.355022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('750ea46d-7298-43ac-a56d-08093fc56a42',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.559040] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 in Status: SUCCESS [ 1151.559304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.659782] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1151.660587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.660902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.661220] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.661541] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.661795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.662033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.662379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.662576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.662757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.663040] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.729151] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.729151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.729151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.729151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.729151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.729151] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 7a524b94-5ca7-497a-8066-258b28fe2992 not found, creating... [ 1151.729151] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.729151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.729151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.729151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.729151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.729933] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.730284] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.730524] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.730864] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.731091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.731308] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 7a524b94-5ca7-497a-8066-258b28fe2992 is going to be created. [ 1151.756257] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.756601] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.756743] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.757442] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.757442] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.757610] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-7a524b94-5ca7-497a-8066-258b28fe2992" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.857690] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-505279a2-0eaf-42f5-83ce-248a1f6eec1d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.857826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.858044] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('505279a2-0eaf-42f5-83ce-248a1f6eec1d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.858964] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 750ea46d-7298-43ac-a56d-08093fc56a42 with status ACTIVE [ 1151.859163] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.859294] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.859359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.859611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.859701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.859882] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.859983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.860067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.860230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.860310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.860510] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.860616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.860684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.860849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.860923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.861016] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 750ea46d-7298-43ac-a56d-08093fc56a42 is going to be updated. [ 1151.902474] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.902567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.902642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.902857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.903083] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.903272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-750ea46d-7298-43ac-a56d-08093fc56a42" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.170630] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.170630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.170871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.171175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.171392] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.171514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.171582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.171762] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.171851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.171943] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.172192] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.172444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.172587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.172895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.173144] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.173384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.173526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.173919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.174094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.174199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.174373] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.363603] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('505279a2-0eaf-42f5-83ce-248a1f6eec1d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.369869] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 936eb902-9d4d-4db7-a735-4f3a5141250f in Status: SUCCESS [ 1152.370081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.370275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.370500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.370754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.370953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.371033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.371265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.371355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.371441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.371552] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.548693] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1152.549045] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 1152.549045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.677728] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d975b5-946d-46cc-a181-419245c51c87: rpc.has_security_group_logging(os_id): False [ 1152.696998] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.697231] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.697231] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.697472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.697598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.697809] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.697958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.698154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.698220] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.698268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.698669] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.698669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.698669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.698869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.698869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.699128] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.699470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.699818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.699818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.699818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.700113] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1152.732678] env[61538]: INFO networking_nsxv3.common.synchronization [req-7dab3236-4f9b-449f-b218-9bcbb2cc2428 req-ba12ffce-c991-4b5b-962c-3e260e8c49be service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 1152.732962] env[61538]: INFO networking_nsxv3.common.synchronization [req-7dab3236-4f9b-449f-b218-9bcbb2cc2428 req-ba12ffce-c991-4b5b-962c-3e260e8c49be service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1152.733217] env[61538]: INFO networking_nsxv3.common.synchronization [req-7dab3236-4f9b-449f-b218-9bcbb2cc2428 req-ba12ffce-c991-4b5b-962c-3e260e8c49be service nova] Enqueued Resource ID: 7a524b94-5ca7-497a-8066-258b28fe2992 with Priority: HIGHEST for action port [ 1152.733900] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 1152.740038] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1152.740038] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a524b94-5ca7-497a-8066-258b28fe2992 with Priority: HIGHEST for action port [ 1152.740038] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.740038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.740038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.741983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.741983] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.742739] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.742998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.743144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.743404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.743612] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.745989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.745989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.745989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.745989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.745989] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.745989] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a524b94-5ca7-497a-8066-258b28fe2992 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.745989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a524b94-5ca7-497a-8066-258b28fe2992" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.745989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a524b94-5ca7-497a-8066-258b28fe2992" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.745989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a524b94-5ca7-497a-8066-258b28fe2992" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.745989] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a524b94-5ca7-497a-8066-258b28fe2992',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.766743] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.766940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.766940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.767168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.767324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.789298] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1152.869790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.869790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.869790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.869790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.869790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.869790] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d is going to be created. [ 1152.875805] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.919022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.919022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.928838] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d in Status: UNINITIALIZED for 2s [ 1153.250708] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.252627] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.252627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.252627] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a524b94-5ca7-497a-8066-258b28fe2992 with status ACTIVE [ 1153.252627] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.252627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.252627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.252627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.252627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.253014] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.253014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.253014] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.253389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.253389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.253562] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.253637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.253766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.254028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.254386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.254386] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a524b94-5ca7-497a-8066-258b28fe2992 is going to be updated. [ 1153.304083] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.304286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.304286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.304508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.304649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.304839] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a524b94-5ca7-497a-8066-258b28fe2992" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.379081] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 936eb902-9d4d-4db7-a735-4f3a5141250f: rpc.has_security_group_logging(os_id): False [ 1153.409042] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.409042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.409042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.409426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.409489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.409864] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.410029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.410120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.410381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.410476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.410619] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 936eb902-9d4d-4db7-a735-4f3a5141250f is going to be created. [ 1153.517268] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.517502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.517502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.517705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.518111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.532789] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 936eb902-9d4d-4db7-a735-4f3a5141250f in Status: IN_PROGRESS for 2s [ 1153.757172] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.259455] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.259756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.259842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.260276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.260443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.260563] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1154.295538] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.295820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.295820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.296094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.296263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.306333] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1154.813648] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1154.813648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.813648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.813648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.813648] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.941532] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d in Status: SUCCESS [ 1154.941532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.941532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.941532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.941532] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.941892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.941892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.941892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.941892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.942058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.942096] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('505279a2-0eaf-42f5-83ce-248a1f6eec1d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.318513] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.318513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.318513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.318513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.318513] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.318513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.318513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.318513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.318513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.318513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.318513] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.447056] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-505279a2-0eaf-42f5-83ce-248a1f6eec1d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.450019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.450019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-505279a2-0eaf-42f5-83ce-248a1f6eec1d taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.450019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.450019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.450684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.450684] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('505279a2-0eaf-42f5-83ce-248a1f6eec1d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.547726] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 936eb902-9d4d-4db7-a735-4f3a5141250f in Status: SUCCESS [ 1155.548608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.825382] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.825382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.825382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.825382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.827386] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.827386] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.827386] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.827386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.827386] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.954339] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 505279a2-0eaf-42f5-83ce-248a1f6eec1d: rpc.has_security_group_logging(os_id): False [ 1155.976638] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.977057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.977191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.979479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.979615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.980355] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.980533] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.980610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.980786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.981459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.981459] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.981459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.981459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.981643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.981643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.981807] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.981907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.981977] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.982168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.982235] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.983214] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d is going to be created. [ 1156.046999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.047365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.047365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.047543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.047740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.062539] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d in Status: IN_PROGRESS for 2s [ 1156.316993] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1156.317080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.317233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.317454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.317650] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.317760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.317828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.318068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.318068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.318202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.318248] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.329047] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d975b5-946d-46cc-a181-419245c51c87: rpc.has_security_group_logging(os_id): False [ 1156.350871] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.350871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.350871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.351304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.351304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.351385] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.351485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.351624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.351691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.351831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.352083] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.352207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.352269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.352430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.352506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.352717] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.352828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.352882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.353041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.353122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.353211] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1156.430180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.430414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.430490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.430796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.430960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.449120] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1156.821354] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.821562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.821661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.822222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.822222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.822442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.822442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.822652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.822779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.822918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.823135] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.823267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.823353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.823552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.823759] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.823890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.823975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.824199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.824319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.824432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.824562] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.327714] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fcbd20b-13e3-44c4-bf9a-746a1da000dc: rpc.has_security_group_logging(os_id): False [ 1157.361353] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.361504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.361577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.361808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.361916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.362169] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.362298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.362350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.362522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.362604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.362810] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.362917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.362978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.363160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.363226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.363445] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.363558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.363622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.363766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.363842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.363930] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1157.460461] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.460684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.460684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.460921] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.461055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.475941] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1157.740081] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1157.740195] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1158.075581] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d in Status: SUCCESS [ 1158.075581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.465978] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1158.466316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.900021] env[61538]: INFO networking_nsxv3.common.synchronization [req-c0178472-2eb8-4855-bc60-6d14d78f909b req-0e4e7436-b5d2-4b80-98a2-097b177e2be9 tempest-AttachVolumeShelveTestJSON-1204522908 tempest-AttachVolumeShelveTestJSON-1204522908-project-member] Enqueued Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_members [ 1158.900293] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_members [ 1158.900683] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.900853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.900853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.901172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.901340] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.901443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.901497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.901663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.901753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.901847] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.403672] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.405558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.405558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.405558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.405558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.405558] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.405558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.405558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.405558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.405558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.405558] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6585f491-6358-4615-a571-0639903266ae already deleted. [ 1159.405558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.489805] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1159.489805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.560195] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.560195] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.560195] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.560195] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.560195] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.560550] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.560795] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.561172] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.561467] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.561789] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1159.562104] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.562401] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.562683] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.562896] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1159.563114] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.563348] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.585057] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.585388] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1159.585584] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.585806] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.586268] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.586542] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.586755] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.587174] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.587336] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e06d5cf8-450e-488f-8ba6-9e7d62811ba1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.012205] env[61538]: INFO networking_nsxv3.common.synchronization [req-08d7dd44-0992-4334-9dbc-1bd389dadc0b req-8568e0fd-d850-4ebf-bfeb-555fcec0fdcc tempest-ServerTagsTestJSON-1274712918 tempest-ServerTagsTestJSON-1274712918-project-member] Enqueued Resource ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 with Priority: HIGHEST for action security_group_members [ 1160.012205] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 with Priority: HIGHEST for action security_group_members [ 1160.012760] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc4f43e-d331-4f7a-8140-5609ba8b2867 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.012760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.012905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.013353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.013353] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.013983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.013983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.013983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.013983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.013983] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc4f43e-d331-4f7a-8140-5609ba8b2867',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.090347] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.090692] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.090778] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.091102] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.091284] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.091491] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port e06d5cf8-450e-488f-8ba6-9e7d62811ba1 not found, creating... [ 1160.091808] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.091971] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.092195] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.092376] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.092586] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.092909] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.093630] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.093804] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.094239] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.094436] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.094644] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: e06d5cf8-450e-488f-8ba6-9e7d62811ba1 is going to be created. [ 1160.118845] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.118845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.118845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.118845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.118845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.118845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.518221] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.518752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.518900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.519113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.519218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.519427] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.519539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.519601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.519815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.519901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.519990] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 is going to be updated. [ 1160.529229] env[61538]: INFO networking_nsxv3.common.synchronization [req-a05eb6d5-912b-42e3-ad74-02d8851ff431 req-eb64b6f9-0304-4254-9183-0cf7f73af41a tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1160.529798] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1160.530304] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.530446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.530510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.530678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.530909] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.530976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.531022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.531144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.531230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.531322] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.551767] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.551946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.551996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.552244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.552397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.561708] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 in Status: IN_PROGRESS for 2s [ 1161.030231] env[61538]: INFO networking_nsxv3.common.synchronization [req-a05eb6d5-912b-42e3-ad74-02d8851ff431 req-71369214-ca09-4352-a301-cb292f1977f6 tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1161.030826] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1161.031756] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.031879] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.033162] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.534953] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.677260] env[61538]: INFO networking_nsxv3.common.synchronization [req-c0178472-2eb8-4855-bc60-6d14d78f909b req-26e8b6d6-d409-4ef7-83b7-a6de680771bf service nova] Enqueued Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_rules [ 1161.677448] env[61538]: INFO networking_nsxv3.common.synchronization [req-c0178472-2eb8-4855-bc60-6d14d78f909b req-26e8b6d6-d409-4ef7-83b7-a6de680771bf service nova] Enqueued Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_members [ 1161.677686] env[61538]: INFO networking_nsxv3.common.synchronization [req-c0178472-2eb8-4855-bc60-6d14d78f909b req-26e8b6d6-d409-4ef7-83b7-a6de680771bf service nova] Enqueued Resource ID: e06d5cf8-450e-488f-8ba6-9e7d62811ba1 with Priority: HIGHEST for action port [ 1161.678251] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_rules [ 1161.678388] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_members [ 1161.678517] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e06d5cf8-450e-488f-8ba6-9e7d62811ba1 with Priority: HIGHEST for action port [ 1161.679607] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.679866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.680052] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.680388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.680550] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.681554] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.681817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.682081] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.682359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.682599] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.682760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.682867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.683080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.683241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.683376] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.684571] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.684709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.684820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.685058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.685170] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e06d5cf8-450e-488f-8ba6-9e7d62811ba1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.015718] env[61538]: INFO networking_nsxv3.common.synchronization [req-a05eb6d5-912b-42e3-ad74-02d8851ff431 req-4f6683b4-f348-4a99-a4a0-6b0a8cf49a49 tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1162.015718] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1162.015718] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.015718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.042948] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.042948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.042948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.042948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.042948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.042948] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1162.069517] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.070018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.070267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.070599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.070873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.080845] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1162.187317] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.187317] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.187573] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.188520] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e06d5cf8-450e-488f-8ba6-9e7d62811ba1 with status ACTIVE [ 1162.188620] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.188682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.189254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.189254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.189254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.189254] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.189464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.189464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.189523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.189555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.189781] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.189868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.189932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.190104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.190180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.190263] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e06d5cf8-450e-488f-8ba6-9e7d62811ba1 is going to be updated. [ 1162.213806] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.213806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.213806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.213806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.214579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.214579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.573994] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 in Status: SUCCESS [ 1162.573994] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc4f43e-d331-4f7a-8140-5609ba8b2867 deletion is rescheduled due to dependency. [ 1162.573994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc4f43e-d331-4f7a-8140-5609ba8b2867" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.692073] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.196312] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.196312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.196312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.196312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.196312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.196312] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6585f491-6358-4615-a571-0639903266ae is going to be created. [ 1163.230378] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.230624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.230698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.230946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.231189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.245741] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6585f491-6358-4615-a571-0639903266ae in Status: UNINITIALIZED for 2s [ 1164.093587] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1164.093987] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.094112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.094265] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.094443] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.094566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.094634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.094803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.094893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.095031] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.600954] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.601175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.601260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.601623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.601623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.602790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.602790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.602790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.602790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.602790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.602790] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1164.635336] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.635545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.635545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.635754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.635960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.646899] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1164.658484] env[61538]: INFO networking_nsxv3.common.synchronization [req-3ed5c8b7-b791-4a08-a4e7-6ec0b12d3875 req-8390b763-22b6-4015-8211-14a6e38583c5 tempest-ServerGroupTestJSON-1228520834 tempest-ServerGroupTestJSON-1228520834-project-member] Enqueued Resource ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d with Priority: HIGHEST for action security_group_members [ 1164.658871] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d with Priority: HIGHEST for action security_group_members [ 1164.659232] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-505279a2-0eaf-42f5-83ce-248a1f6eec1d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.659373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.659443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.659651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.659888] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.659994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.660241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.660408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.660505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.660609] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('505279a2-0eaf-42f5-83ce-248a1f6eec1d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.165371] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.165371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.165784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.165784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.165784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.165938] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.166096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.166168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.166331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.166409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.166501] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d is going to be updated. [ 1165.201371] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.201371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.201371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.201649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.201649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.213865] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d in Status: IN_PROGRESS for 2s [ 1165.260568] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6585f491-6358-4615-a571-0639903266ae in Status: SUCCESS [ 1165.261425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.263053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.263053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.263053] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.263053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.263053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.263722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.264026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.264323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.264621] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.768915] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.269922] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6585f491-6358-4615-a571-0639903266ae: rpc.has_security_group_logging(os_id): False [ 1166.296030] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.296030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.296030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.296030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.296030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.296030] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.296030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.296030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.296030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.296030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.296030] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6585f491-6358-4615-a571-0639903266ae is going to be created. [ 1166.361685] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.361685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.361685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.361685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.361685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.378319] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6585f491-6358-4615-a571-0639903266ae in Status: IN_PROGRESS for 2s [ 1166.660514] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1166.660726] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 deletion is rescheduled due to dependency. [ 1166.660886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.662076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.662076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.662076] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.662076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.662076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.662076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.662489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.662489] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.165509] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.166479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.166479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.166479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.166479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.166479] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.166479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.166479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.166822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.166822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.166822] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1167.196712] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.196941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.197068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.197372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.197452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.211960] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1167.223456] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d in Status: SUCCESS [ 1167.223685] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 505279a2-0eaf-42f5-83ce-248a1f6eec1d deletion is rescheduled due to dependency. [ 1167.223854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-505279a2-0eaf-42f5-83ce-248a1f6eec1d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.401634] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6585f491-6358-4615-a571-0639903266ae in Status: SUCCESS [ 1168.401895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.128586] env[61538]: INFO networking_nsxv3.common.synchronization [req-89f21fb6-feaf-4c53-b018-51373701c2f5 req-7e9102e6-0c88-4a7f-a80f-39d451e88fb9 tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1169.128586] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1169.128754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.128810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.129362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.129362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.129362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.129362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.129584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.129584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.129643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.129689] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.224272] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1169.224510] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 deletion is rescheduled due to dependency. [ 1169.224662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.632506] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.633957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.633957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.633957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.633957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.633957] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.633957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.633957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.633957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.633957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.633957] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1169.665928] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.665928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.665928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.665928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.665928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.674813] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1171.686328] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1171.686642] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 1171.686642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.752170] env[61538]: INFO networking_nsxv3.common.synchronization [req-146ec56c-0964-4e25-8f79-23113fcf9f4e req-69bfc90a-415b-42ed-87aa-ec00d365173b tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1173.752732] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1173.753435] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.753565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.753635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.753836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.753996] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.754118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.754181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.754328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.754417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.754512] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.257978] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.258090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.258144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.258325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.258418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.258666] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.260274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.260274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.260274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.260274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.260274] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1174.273583] env[61538]: INFO networking_nsxv3.common.synchronization [req-146ec56c-0964-4e25-8f79-23113fcf9f4e req-948c38ea-8576-4cfd-8b3a-d05686d507a2 tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1174.274189] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1174.274490] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.274594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.289748] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.289949] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.290016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.290212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.290349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.300881] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1174.490805] env[61538]: INFO networking_nsxv3.common.synchronization [req-4673c2a5-7b9a-4f1a-b4ac-176067f38cf7 req-6b420a47-1bc6-4eba-9369-899dedc45aab tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_members [ 1174.491507] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGHEST for action security_group_members [ 1174.491929] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.492259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.492371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.492654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.492831] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.493074] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.493074] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.493195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.493295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.493351] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.995135] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.995476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.995476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.995608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.995706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.995964] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.996086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.996150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.996308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.996386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.996472] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c is going to be updated. [ 1175.027233] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-870 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.028247] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-870" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.028447] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-870" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.028828] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-870" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.029510] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.029787] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.030015] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.030322] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.030881] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.031091] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.031293] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.031466] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.031848] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.032103] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.032287] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.032622] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.034816] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.035138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.035199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.035475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.035666] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.045749] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c in Status: IN_PROGRESS for 2s [ 1175.054636] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.055664] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1175.055840] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.056059] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-870" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.056428] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.056621] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.056751] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.057105] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.057259] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.561265] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.561527] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.561611] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.561907] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.562107] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.562280] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46 not found, creating... [ 1175.562552] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.562720] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.562846] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.563090] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.563292] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.563633] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.563843] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.563987] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.564227] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.564373] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.564519] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46 is going to be created. [ 1175.585572] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.585819] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.586387] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.586387] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.586555] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.586790] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.312660] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1176.312952] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 deletion is rescheduled due to dependency. [ 1176.313135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.313257] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.313693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.313794] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.315359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.315359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.315359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.315359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.315359] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.432318] env[61538]: INFO networking_nsxv3.common.synchronization [req-146ec56c-0964-4e25-8f79-23113fcf9f4e req-471f98d9-acd5-41e3-bd60-2a2ec4afc64d service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1176.432318] env[61538]: INFO networking_nsxv3.common.synchronization [req-146ec56c-0964-4e25-8f79-23113fcf9f4e req-471f98d9-acd5-41e3-bd60-2a2ec4afc64d service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1176.432318] env[61538]: INFO networking_nsxv3.common.synchronization [req-146ec56c-0964-4e25-8f79-23113fcf9f4e req-471f98d9-acd5-41e3-bd60-2a2ec4afc64d service nova] Enqueued Resource ID: 4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46 with Priority: HIGHEST for action port [ 1176.432585] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1176.432851] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1176.433146] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46 with Priority: HIGHEST for action port [ 1176.433512] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.433736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.433940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.434225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.434397] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.435444] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.435650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.435937] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.436191] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.437018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.437018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.437018] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.817059] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.939145] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.939314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.939410] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46 with status ACTIVE [ 1176.939579] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.939685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.939751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.940053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.940168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.940357] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.940467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.940527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.940690] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.940773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.940956] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.941082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.941146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.941290] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.941367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.941453] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46 is going to be updated. [ 1176.963616] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.963725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.963798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.964057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.964283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.964436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c4e5fb5-9ff7-4a97-9cc6-f23a09acbd46" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.062189] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c in Status: SUCCESS [ 1177.062409] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c deletion is rescheduled due to dependency. [ 1177.062534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.234726] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.234726] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-117" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.234726] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-117" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.234946] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-117" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.235094] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.235257] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.236031] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.236031] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.236031] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.236031] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.236205] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.236205] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.236340] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.236426] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.236571] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.236720] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.256801] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.256979] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.257140] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.257328] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-117" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.257666] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-84ae420f-63eb-44ec-82d6-f35d63f23506 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.257940] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-84ae420f-63eb-44ec-82d6-f35d63f23506" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.258113] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-84ae420f-63eb-44ec-82d6-f35d63f23506" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.258483] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-84ae420f-63eb-44ec-82d6-f35d63f23506" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.258629] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84ae420f-63eb-44ec-82d6-f35d63f23506',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.320231] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.761723] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.762013] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.762201] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.762534] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.762731] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.762926] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 84ae420f-63eb-44ec-82d6-f35d63f23506 not found, creating... [ 1177.763257] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.763463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.763601] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.763872] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.764059] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.764399] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.764588] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.764746] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.765009] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.765198] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.765460] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 84ae420f-63eb-44ec-82d6-f35d63f23506 is going to be created. [ 1177.786252] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.786482] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.786634] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.786965] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.787255] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.787530] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-84ae420f-63eb-44ec-82d6-f35d63f23506" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.823399] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.823600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.823660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.823902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.824018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.824121] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1177.855595] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.855595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.855595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.855595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.855595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.867026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1178.603032] env[61538]: INFO networking_nsxv3.common.synchronization [req-146ec56c-0964-4e25-8f79-23113fcf9f4e req-10810bf7-4e44-4e85-8a6d-9046dfcb057b service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1178.603347] env[61538]: INFO networking_nsxv3.common.synchronization [req-146ec56c-0964-4e25-8f79-23113fcf9f4e req-10810bf7-4e44-4e85-8a6d-9046dfcb057b service nova] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1178.603347] env[61538]: INFO networking_nsxv3.common.synchronization [req-146ec56c-0964-4e25-8f79-23113fcf9f4e req-10810bf7-4e44-4e85-8a6d-9046dfcb057b service nova] Enqueued Resource ID: 84ae420f-63eb-44ec-82d6-f35d63f23506 with Priority: HIGHEST for action port [ 1178.603795] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_rules [ 1178.603996] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1178.608076] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84ae420f-63eb-44ec-82d6-f35d63f23506 with Priority: HIGHEST for action port [ 1178.608076] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.608076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.608076] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.608076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.608076] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-84ae420f-63eb-44ec-82d6-f35d63f23506 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.608076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84ae420f-63eb-44ec-82d6-f35d63f23506" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.608076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84ae420f-63eb-44ec-82d6-f35d63f23506" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.608076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84ae420f-63eb-44ec-82d6-f35d63f23506" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.608076] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84ae420f-63eb-44ec-82d6-f35d63f23506',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.111455] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84ae420f-63eb-44ec-82d6-f35d63f23506 with status ACTIVE [ 1179.111555] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.111698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.111730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.111999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.112113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.112347] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.112495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.112495] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.112677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.112723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.112892] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.112983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.113062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.113201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.113275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.113357] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84ae420f-63eb-44ec-82d6-f35d63f23506 is going to be updated. [ 1179.136351] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.136488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.137354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.137354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.137354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.137354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84ae420f-63eb-44ec-82d6-f35d63f23506" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.284038] env[61538]: INFO networking_nsxv3.common.synchronization [None req-3802d9aa-7203-4d13-b87d-d1b45334a85e tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_rules [ 1179.284586] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_rules [ 1179.284902] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-186c4c09-0cac-4aaf-99ba-5ef21930c905 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.285040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.285112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.285439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.285528] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.362999] env[61538]: INFO networking_nsxv3.common.synchronization [None req-b0ad5f0b-1451-4a31-9425-f23280a612f5 tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_rules [ 1179.363631] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_rules [ 1179.363977] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-186c4c09-0cac-4aaf-99ba-5ef21930c905 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.364146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.811165] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.811593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.811593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.814017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.814170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.814289] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 already deleted. [ 1179.814393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.814760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.814760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.814852] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.879105] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1179.879338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.879916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.880154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.880347] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.880462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.880529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.880680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.880761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.880858] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.339781] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.340709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.340932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.341283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.341499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.341690] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 already deleted. [ 1180.341855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.387353] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.889646] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.394703] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.394703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.394703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.394703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.394703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.394703] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1181.425930] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.427330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.429630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.429630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.429630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.444598] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1181.676248] env[61538]: INFO networking_nsxv3.common.synchronization [req-f8e18fad-8404-46cf-935c-21a80a18aaf6 req-3457e1d6-8d3b-4dda-a704-ef918baa1d0f tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1181.676780] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1181.677099] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.677227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.677295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.677497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.677642] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.677747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.677806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.677984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.678101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.678199] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.180920] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.181288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.181288] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.181353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.181444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.181635] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.181771] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.181827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.182685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.182814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.182935] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1182.212173] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.212173] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.212414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.212456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.213169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.222525] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1182.354110] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.354333] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.354518] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.354726] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.354997] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.355177] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.355301] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.355519] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.355672] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.355887] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1182.356014] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.356142] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.356256] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.356372] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1182.356494] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.356681] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.374850] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.375048] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1182.375200] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.375385] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-130" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.375762] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.375951] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.376092] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.376791] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.376791] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.878775] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.878978] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.879262] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.879399] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.879581] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.879741] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99 not found, creating... [ 1182.880162] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.880305] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.880382] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.880582] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.881418] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.881418] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.881418] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.881418] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.881619] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.881683] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.881823] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99 is going to be created. [ 1182.902786] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.902993] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.903138] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.903415] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.903649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.903879] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.459138] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1183.459138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.459138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.459138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.459138] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.459138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.459138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.459138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.459138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.459138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.459138] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.459823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.459823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.459823] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.459998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.459998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.460193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.460253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.460367] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.687382] env[61538]: INFO networking_nsxv3.common.synchronization [req-f8e18fad-8404-46cf-935c-21a80a18aaf6 req-4b375a65-3865-4a3c-9b85-4547b2369fb3 service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 1183.687382] env[61538]: INFO networking_nsxv3.common.synchronization [req-f8e18fad-8404-46cf-935c-21a80a18aaf6 req-4b375a65-3865-4a3c-9b85-4547b2369fb3 service nova] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1183.687574] env[61538]: INFO networking_nsxv3.common.synchronization [req-f8e18fad-8404-46cf-935c-21a80a18aaf6 req-4b375a65-3865-4a3c-9b85-4547b2369fb3 service nova] Enqueued Resource ID: f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99 with Priority: HIGHEST for action port [ 1183.687720] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_rules [ 1183.687844] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1183.688031] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99 with Priority: HIGHEST for action port [ 1183.688610] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.688761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.688792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.688978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.689066] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.691140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.691382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.691992] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.691992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.691992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.692188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.692274] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.962423] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.962600] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.962751] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.191892] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.192109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.196039] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99 with status ACTIVE [ 1184.196039] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.196039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.196039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.196475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.196475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.196475] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.196595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.196678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.198041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.198041] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.198041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.198279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.198348] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.198526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.198621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.198744] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99 is going to be updated. [ 1184.224364] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.225047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.225047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.225047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.225794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.225794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f28dcdfe-4dc7-43c7-bcf1-59fb2da6cf99" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.239732] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1184.239907] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 1184.240080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.240346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.240479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.240690] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.240817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.240885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.241066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.241155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.241252] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.465119] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.743485] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.967225] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.967422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.967488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.967733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.967840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.967948] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1185.001456] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.001591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.001657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.001953] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.002154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.013950] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1185.249442] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.608857] env[61538]: INFO networking_nsxv3.common.synchronization [req-6904f097-9495-4161-a35c-ac1330e28f6c req-58ec9672-5a28-440b-b449-2309bfface27 tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_members [ 1185.612503] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_members [ 1185.612503] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-186c4c09-0cac-4aaf-99ba-5ef21930c905 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.612503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.612503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.612503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.612503] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.612503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.612503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.612503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.612503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.612503] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.751530] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.751895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.751895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.752220] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.752365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.752508] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1185.788124] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.788213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.788282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.788496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.788678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.800899] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1185.978590] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.978786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.978913] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.979230] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.979495] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.979656] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.981397] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.981397] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.981397] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.981397] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.981397] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.981397] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.981397] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.981397] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.981397] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.981397] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.000423] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.000600] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1186.000735] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.000923] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-845" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.001426] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-ce048a59-c941-4a83-bbf9-29dfc46aae60 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.001602] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-ce048a59-c941-4a83-bbf9-29dfc46aae60" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.001734] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-ce048a59-c941-4a83-bbf9-29dfc46aae60" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.002097] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-ce048a59-c941-4a83-bbf9-29dfc46aae60" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.002267] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce048a59-c941-4a83-bbf9-29dfc46aae60',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.113244] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.113487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.113487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.113706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.113773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.113937] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.114047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.114108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.114287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.114368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.114458] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 already deleted. [ 1186.114539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.504846] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.505258] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.505258] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.505561] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.505711] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.509180] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port ce048a59-c941-4a83-bbf9-29dfc46aae60 not found, creating... [ 1186.509180] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.509180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.509180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.509180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.509180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.509180] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.509180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.509180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.509180] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.509704] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.509704] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: ce048a59-c941-4a83-bbf9-29dfc46aae60 is going to be created. [ 1186.529410] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.529714] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.529847] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.530254] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.530492] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.530768] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-ce048a59-c941-4a83-bbf9-29dfc46aae60" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.025446] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1187.025793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.025872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.026120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.026319] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.026436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.026503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.026646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.026729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.026811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.026959] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.027063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.027155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.027262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.027397] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.027487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.027547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.027679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.027754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.027831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.027935] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.213997] env[61538]: INFO networking_nsxv3.common.synchronization [req-6904f097-9495-4161-a35c-ac1330e28f6c req-a0180480-0fe3-4d0f-bb20-36096bddab3f service nova] Enqueued Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_rules [ 1187.214220] env[61538]: INFO networking_nsxv3.common.synchronization [req-6904f097-9495-4161-a35c-ac1330e28f6c req-a0180480-0fe3-4d0f-bb20-36096bddab3f service nova] Enqueued Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_members [ 1187.214368] env[61538]: INFO networking_nsxv3.common.synchronization [req-6904f097-9495-4161-a35c-ac1330e28f6c req-a0180480-0fe3-4d0f-bb20-36096bddab3f service nova] Enqueued Resource ID: ce048a59-c941-4a83-bbf9-29dfc46aae60 with Priority: HIGHEST for action port [ 1187.214629] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_rules [ 1187.215078] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_members [ 1187.215078] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce048a59-c941-4a83-bbf9-29dfc46aae60 with Priority: HIGHEST for action port [ 1187.215861] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-186c4c09-0cac-4aaf-99ba-5ef21930c905 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.215991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.216080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.216292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.216388] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.217467] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-186c4c09-0cac-4aaf-99ba-5ef21930c905 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.217649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.217760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.218322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.218322] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.218472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.218583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.218819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.218947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.219087] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.219954] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce048a59-c941-4a83-bbf9-29dfc46aae60 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.220211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce048a59-c941-4a83-bbf9-29dfc46aae60" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.220211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce048a59-c941-4a83-bbf9-29dfc46aae60" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.220344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce048a59-c941-4a83-bbf9-29dfc46aae60" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.220427] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce048a59-c941-4a83-bbf9-29dfc46aae60',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.530328] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d975b5-946d-46cc-a181-419245c51c87: rpc.has_security_group_logging(os_id): False [ 1187.563327] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.563524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.563524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.563710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.563815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.564092] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.564255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.564255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.564388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.564464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.564645] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.564737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.564797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.564933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.565016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.565200] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.565293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.565352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.565526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.565581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.565647] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1187.675664] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.675813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.675883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.676118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.676271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.694154] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1187.721935] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-186c4c09-0cac-4aaf-99ba-5ef21930c905 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.722076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.723392] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.724322] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce048a59-c941-4a83-bbf9-29dfc46aae60 with status ACTIVE [ 1187.724507] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.724625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.724693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.724902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.724993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.725196] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.725322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.725364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.725485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.725562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.725736] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.725827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.725887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.726038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.726114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.726198] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce048a59-c941-4a83-bbf9-29dfc46aae60 is going to be updated. [ 1187.769533] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.769714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.769787] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.770122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.770301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.770493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce048a59-c941-4a83-bbf9-29dfc46aae60" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.811353] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1187.811565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.811737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.811977] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.812197] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.812324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.812391] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.812550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.812635] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.812725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.812819] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.229163] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.315127] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.315315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.315654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.315654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.315759] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.315860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.315924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.316094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.316185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.316272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.316415] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.316508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.316602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.316712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.316849] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.316939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.316999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.317168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.317246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.317472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.317472] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.731755] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.731906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.731997] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.732210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.732309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.732429] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 is going to be created. [ 1188.757362] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.757504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.757560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.757772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.757942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.767561] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 in Status: UNINITIALIZED for 2s [ 1188.819153] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fcbd20b-13e3-44c4-bf9a-746a1da000dc: rpc.has_security_group_logging(os_id): False [ 1188.837483] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.837641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.837783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.837950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.838117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.838331] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.838489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.838528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.838709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.838780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.839022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.839109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.839141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.839298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.839392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.839665] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.839838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.839838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.840050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.840133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.840247] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1188.921137] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.921528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.921528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.921859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.922045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.939539] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1189.713292] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1189.713614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.713816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.714221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.714397] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.217285] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.217652] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.217780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.217950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.218158] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.218284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.218360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.218509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.218601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.218682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.218869] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.266770] env[61538]: INFO networking_nsxv3.common.synchronization [req-58634b01-fc2d-4747-9fee-af0ee3b0409f req-35e971b8-84d8-4d5e-9628-3fc15656445d tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1190.267767] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1190.267767] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.267767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.267767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.267991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.268199] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.268310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.268372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.268527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.268615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.268710] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.527983] env[61538]: INFO networking_nsxv3.common.synchronization [req-58634b01-fc2d-4747-9fee-af0ee3b0409f req-434f9fe9-d2f6-4ca1-aa5c-6ec732f711da tempest-ServersTestMultiNic-619370263 tempest-ServersTestMultiNic-619370263-project-member] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1190.528654] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGHEST for action security_group_members [ 1190.528977] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.529243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.721222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.721558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.772056] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.778708] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 in Status: SUCCESS [ 1190.778947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.779131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.779356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.779551] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.779668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.779733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.779887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.779973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.780158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.780197] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.953928] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1190.954203] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.273370] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.283022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.775569] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.775946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.775946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.776045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.776148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.776249] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1191.785164] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 186c4c09-0cac-4aaf-99ba-5ef21930c905: rpc.has_security_group_logging(os_id): False [ 1191.815844] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.816101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.816209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.816454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.816607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.816975] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.817154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.817259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.817506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.817639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.817779] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 is going to be created. [ 1191.843411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.843624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.843705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.843904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.844097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.854540] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1191.903883] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.903883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.903883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.904298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.904298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.914446] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 in Status: IN_PROGRESS for 2s [ 1193.866847] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1193.867260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.867449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.867916] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.868219] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.868395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.868523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.868780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.868928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.869135] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.928687] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 in Status: SUCCESS [ 1193.928956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.372282] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.372451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.372525] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.372758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.372856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.373073] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.373180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.373243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.373396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.373473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.373561] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1194.399949] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.400207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.400207] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.400459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.400611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.414628] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1195.529623] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1195.529957] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1196.430124] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1196.430124] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d975b5-946d-46cc-a181-419245c51c87 deletion is rescheduled due to dependency. [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.430124] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.430124] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.430124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.430702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.430702] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.430702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.430702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.430814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.430960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.430960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.432287] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.934905] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d975b5-946d-46cc-a181-419245c51c87: rpc.has_security_group_logging(os_id): False [ 1196.956975] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.957193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.957249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.957490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.957610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.957877] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.958030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.958107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.958276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.958381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.958577] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.958672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.958752] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.958908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.960352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.960606] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.960711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.960777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.960931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.961034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.961155] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be updated. [ 1197.030883] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.031062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.031152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.031378] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.031529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.053645] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: IN_PROGRESS for 2s [ 1199.077625] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d975b5-946d-46cc-a181-419245c51c87 in Status: SUCCESS [ 1199.078222] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.256084] env[61538]: INFO networking_nsxv3.common.synchronization [None req-52f83dbd-ca1c-47ab-a4fb-4ac7ebca6529 None None] Enqueued Resource ID: 0a1a21c1-1321-4ac9-b762-4fab089df5b5 with Priority: HIGHEST for action port [ 1200.257089] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1a21c1-1321-4ac9-b762-4fab089df5b5 with Priority: HIGHEST for action port [ 1200.258022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a1a21c1-1321-4ac9-b762-4fab089df5b5 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.258022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a1a21c1-1321-4ac9-b762-4fab089df5b5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.258022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a1a21c1-1321-4ac9-b762-4fab089df5b5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.258022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a1a21c1-1321-4ac9-b762-4fab089df5b5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.258022] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a1a21c1-1321-4ac9-b762-4fab089df5b5',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.332869] env[61538]: INFO networking_nsxv3.common.synchronization [req-8d89bf55-9cf5-4e42-992e-44a9f479a848 req-75fc2127-4f1f-444f-8fc1-17e0853a21d0 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1200.333896] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1200.333896] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.333896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.334142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.334264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.334425] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.334592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.334592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.336137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.336137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.336137] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.673704] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.673931] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.674152] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.674535] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.674799] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.675028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.675181] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.675479] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.675626] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.675858] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.675975] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.676104] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.676217] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.676334] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.676442] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.676580] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.699767] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.699935] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1200.700213] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.700373] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.700727] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-d2fa1081-8512-43d3-ba49-d739e11278fe taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.700924] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-d2fa1081-8512-43d3-ba49-d739e11278fe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.702082] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-d2fa1081-8512-43d3-ba49-d739e11278fe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.702082] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-d2fa1081-8512-43d3-ba49-d739e11278fe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.702082] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2fa1081-8512-43d3-ba49-d739e11278fe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.759898] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a1a21c1-1321-4ac9-b762-4fab089df5b5 [ 1200.760199] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.760441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.760521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.760753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.760849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.760951] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a1a21c1-1321-4ac9-b762-4fab089df5b5 already deleted. [ 1200.761050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a1a21c1-1321-4ac9-b762-4fab089df5b5" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.837621] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.837919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.838063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.838294] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.838411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.838639] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.838746] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.838811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.838968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.839064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.839158] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1200.876571] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.876812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.876883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.877104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.877299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.889547] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1201.204475] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.204725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.204860] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.205192] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.205359] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.205525] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port d2fa1081-8512-43d3-ba49-d739e11278fe not found, creating... [ 1201.205805] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.205963] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.206099] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.206328] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.206474] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.206761] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.206921] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.207055] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.207317] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.207457] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.207604] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: d2fa1081-8512-43d3-ba49-d739e11278fe is going to be created. [ 1201.229223] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.229410] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.229543] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.229848] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.230098] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.230386] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-d2fa1081-8512-43d3-ba49-d739e11278fe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.244951] env[61538]: INFO networking_nsxv3.common.synchronization [req-8c84b275-58cc-46c9-a86c-31a826acb804 req-6b1f4c4f-a0ab-439c-83a1-3128e498102e tempest-ServerActionsTestOtherB-1077210391 tempest-ServerActionsTestOtherB-1077210391-project-member] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1202.244951] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1202.244951] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.244951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.245607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.245936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.246235] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.246458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.246597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.246851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.247046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.248240] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.479540] env[61538]: INFO networking_nsxv3.common.synchronization [req-8d89bf55-9cf5-4e42-992e-44a9f479a848 req-f5b6b127-0c0c-4c7a-9a4b-4ae7e7f620e2 service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1202.479945] env[61538]: INFO networking_nsxv3.common.synchronization [req-8d89bf55-9cf5-4e42-992e-44a9f479a848 req-f5b6b127-0c0c-4c7a-9a4b-4ae7e7f620e2 service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1202.480391] env[61538]: INFO networking_nsxv3.common.synchronization [req-8d89bf55-9cf5-4e42-992e-44a9f479a848 req-f5b6b127-0c0c-4c7a-9a4b-4ae7e7f620e2 service nova] Enqueued Resource ID: d2fa1081-8512-43d3-ba49-d739e11278fe with Priority: HIGHEST for action port [ 1202.481071] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1202.481934] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1202.482741] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2fa1081-8512-43d3-ba49-d739e11278fe with Priority: HIGHEST for action port [ 1202.483210] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.483733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.485204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.485204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.485204] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.489025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.489025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.489025] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2fa1081-8512-43d3-ba49-d739e11278fe taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.489025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2fa1081-8512-43d3-ba49-d739e11278fe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.489025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2fa1081-8512-43d3-ba49-d739e11278fe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.489025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2fa1081-8512-43d3-ba49-d739e11278fe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.489025] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2fa1081-8512-43d3-ba49-d739e11278fe',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.648427] env[61538]: INFO networking_nsxv3.common.synchronization [req-eb09b491-0fdd-4153-b806-4dc906a12256 req-46794011-ff2e-44db-84ab-1b746bf594df tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1202.648987] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1202.650084] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.650084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.650084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.650084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.650568] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.650568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.650568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.650696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.650696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.650760] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.698112] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c3d0aee6-1dc9-447f-933b-62a2acfb5261 None None] Enqueued Resource ID: 850a236d-9fa2-4e6d-9260-32c2c888beb4 with Priority: HIGHEST for action port [ 1202.699907] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850a236d-9fa2-4e6d-9260-32c2c888beb4 with Priority: HIGHEST for action port [ 1202.699907] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-850a236d-9fa2-4e6d-9260-32c2c888beb4 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.699907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-850a236d-9fa2-4e6d-9260-32c2c888beb4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.699907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-850a236d-9fa2-4e6d-9260-32c2c888beb4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.699907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-850a236d-9fa2-4e6d-9260-32c2c888beb4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.699907] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('850a236d-9fa2-4e6d-9260-32c2c888beb4',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.749234] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.749432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.749497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.749776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.749887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.750131] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.750318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.750526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.750593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.750646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.750743] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1202.787359] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.787359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.787359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.787359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.787359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.799239] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1202.901116] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1202.901320] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 deletion is rescheduled due to dependency. [ 1202.901437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.901602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.901836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.902009] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.902135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.902200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.902355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.902437] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.902533] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.994088] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.994088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.994283] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2fa1081-8512-43d3-ba49-d739e11278fe with status ACTIVE [ 1202.997026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.997026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.997026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.997026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.997026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2fa1081-8512-43d3-ba49-d739e11278fe is going to be updated. [ 1203.032772] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.032929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.033055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.033283] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.033550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.033748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2fa1081-8512-43d3-ba49-d739e11278fe" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.153503] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.153654] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.153706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.153927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.154038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.154245] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.156945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.156945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.156945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.156945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.156945] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be updated. [ 1203.189539] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.190913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.191012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.191350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.191441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.202271] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 850a236d-9fa2-4e6d-9260-32c2c888beb4 [ 1203.204941] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.204941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.204941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.204941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.204941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.204941] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:850a236d-9fa2-4e6d-9260-32c2c888beb4 already deleted. [ 1203.204941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-850a236d-9fa2-4e6d-9260-32c2c888beb4" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.205446] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: IN_PROGRESS for 2s [ 1203.405257] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.907966] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.410386] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.410936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.410936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.411206] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.411380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.411556] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1204.450009] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.450360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.450585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.450910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.451323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.464279] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1204.809763] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1204.809929] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 deletion is rescheduled due to dependency. [ 1204.810234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.215883] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 1205.216088] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 deletion is rescheduled due to dependency. [ 1205.216208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.474742] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1206.475153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.475321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.475545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.475829] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.475992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.476079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.476246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.476334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.476421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.476521] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.978726] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.979242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.979242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.979242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.979463] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.979544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.979578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.980308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.980308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.980308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.980572] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.980572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.980572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.981657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.981657] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.981657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.981657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.981657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.981657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.981657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.981657] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.480388] env[61538]: INFO networking_nsxv3.common.synchronization [None req-20869628-0d2c-42aa-b418-28ce91359574 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1207.480942] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1207.483019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.483019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.483019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.483019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.483019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.483019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.483019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.483019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.483019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.483019] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.484368] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1636da8b-a16b-42d3-874d-5d8471397fd6: rpc.has_security_group_logging(os_id): False [ 1207.505092] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.505270] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.505313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.505526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.505623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.505846] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.505946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.506017] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.506166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.506243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.506426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.506510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.506564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.506702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.506776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.506953] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.507066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.507129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.507267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.507344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.507430] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1207.587475] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.587475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.587475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.587475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.587475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.598647] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1207.807683] env[61538]: INFO networking_nsxv3.common.synchronization [req-0d2f308a-bd4e-4809-ab10-13ea2c51ef20 req-53738735-2d60-45ec-b0a7-b1c8ccf38641 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1207.809198] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1207.809422] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.809577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.809775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.810180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.810508] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.810736] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.810810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.811107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.811328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.811465] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.984736] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.249634] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.249925] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.250126] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.250565] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.250873] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.251132] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.251296] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.251573] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.251760] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.252100] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1208.252661] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.253020] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.253173] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.253307] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1208.253429] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.253574] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.273454] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.273641] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1208.273770] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.274022] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.274408] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-dbcc9cc9-fdcd-497b-ad2d-743248442109 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.274602] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-dbcc9cc9-fdcd-497b-ad2d-743248442109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.274729] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-dbcc9cc9-fdcd-497b-ad2d-743248442109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.275080] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-dbcc9cc9-fdcd-497b-ad2d-743248442109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.275230] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbcc9cc9-fdcd-497b-ad2d-743248442109',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.314896] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.315127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.315127] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.315353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.315477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.315698] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.315816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.315881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.316100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.316181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.316296] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc already deleted. [ 1208.316394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.486982] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.778140] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.778383] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.778520] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.778819] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.778974] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.779150] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port dbcc9cc9-fdcd-497b-ad2d-743248442109 not found, creating... [ 1208.779424] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.779590] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.779714] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.779936] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.780109] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.780439] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.780600] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.780723] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.780935] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.781100] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.781263] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: dbcc9cc9-fdcd-497b-ad2d-743248442109 is going to be created. [ 1208.802575] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.804463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.804463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.804463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.804463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.804463] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-dbcc9cc9-fdcd-497b-ad2d-743248442109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.989523] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.989697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.989781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.990028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.990158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.990298] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1209.022110] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.022280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.022404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.022649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.022885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.034240] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1209.613672] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1209.614085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.946168] env[61538]: INFO networking_nsxv3.common.synchronization [req-0d2f308a-bd4e-4809-ab10-13ea2c51ef20 req-841f7e28-2b0b-4e54-9f57-da4d570c833e service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1209.946381] env[61538]: INFO networking_nsxv3.common.synchronization [req-0d2f308a-bd4e-4809-ab10-13ea2c51ef20 req-841f7e28-2b0b-4e54-9f57-da4d570c833e service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1209.946589] env[61538]: INFO networking_nsxv3.common.synchronization [req-0d2f308a-bd4e-4809-ab10-13ea2c51ef20 req-841f7e28-2b0b-4e54-9f57-da4d570c833e service nova] Enqueued Resource ID: dbcc9cc9-fdcd-497b-ad2d-743248442109 with Priority: HIGHEST for action port [ 1209.947198] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1209.947358] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1209.947464] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcc9cc9-fdcd-497b-ad2d-743248442109 with Priority: HIGHEST for action port [ 1209.947738] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.947880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.947942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.948233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.948330] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.949249] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.949357] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.949459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.949613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.949770] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.949875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.949936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.950136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.950228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.950352] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.951298] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbcc9cc9-fdcd-497b-ad2d-743248442109 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.951298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbcc9cc9-fdcd-497b-ad2d-743248442109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.951659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbcc9cc9-fdcd-497b-ad2d-743248442109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.951659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbcc9cc9-fdcd-497b-ad2d-743248442109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.951659] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbcc9cc9-fdcd-497b-ad2d-743248442109',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.105355] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.105556] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.105681] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.105957] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.106605] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.106776] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.106898] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.107248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.107404] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.107621] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.107740] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.107908] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.108052] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.108176] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.108296] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.108432] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.139203] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.139440] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1210.139646] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.139929] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.140482] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-189f9616-2a3c-4fd7-964c-63b93549ef08 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.140772] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-189f9616-2a3c-4fd7-964c-63b93549ef08" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.140958] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-189f9616-2a3c-4fd7-964c-63b93549ef08" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.141611] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-189f9616-2a3c-4fd7-964c-63b93549ef08" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.141828] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('189f9616-2a3c-4fd7-964c-63b93549ef08',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.453525] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.453722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.453844] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.454926] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbcc9cc9-fdcd-497b-ad2d-743248442109 with status ACTIVE [ 1210.455149] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.455277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.455347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.455564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.455657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.455836] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.455938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.455989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.456165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.456247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.456467] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.456567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.456628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.456794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.456877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.456964] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbcc9cc9-fdcd-497b-ad2d-743248442109 is going to be updated. [ 1210.477640] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.477640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.477640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.477914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.478744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.478744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbcc9cc9-fdcd-497b-ad2d-743248442109" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.644293] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.644816] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.644816] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.645044] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.645124] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.645334] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 189f9616-2a3c-4fd7-964c-63b93549ef08 not found, creating... [ 1210.645729] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.645901] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.646058] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.646278] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.646412] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.646707] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.646869] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.646993] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.647225] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.647369] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.647514] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 189f9616-2a3c-4fd7-964c-63b93549ef08 is going to be created. [ 1210.668385] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.668691] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.668761] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.669032] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.669271] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.669503] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-189f9616-2a3c-4fd7-964c-63b93549ef08" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.959759] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.044435] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1211.044696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.462330] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.462538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.462620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.462912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.463056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.463178] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be created. [ 1211.487867] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.488051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.488106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.488351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.488515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.502047] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: UNINITIALIZED for 2s [ 1211.573769] env[61538]: INFO networking_nsxv3.common.synchronization [req-569b3954-9b9c-4e52-8091-163936a69e03 req-57d956d7-c12e-48ab-9685-438c66da4937 service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1211.574419] env[61538]: INFO networking_nsxv3.common.synchronization [req-569b3954-9b9c-4e52-8091-163936a69e03 req-57d956d7-c12e-48ab-9685-438c66da4937 service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1211.574419] env[61538]: INFO networking_nsxv3.common.synchronization [req-569b3954-9b9c-4e52-8091-163936a69e03 req-57d956d7-c12e-48ab-9685-438c66da4937 service nova] Enqueued Resource ID: 189f9616-2a3c-4fd7-964c-63b93549ef08 with Priority: HIGHEST for action port [ 1211.574871] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1211.575741] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1211.575741] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 189f9616-2a3c-4fd7-964c-63b93549ef08 with Priority: HIGHEST for action port [ 1211.575741] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.575741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.575741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.576053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.576137] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.577662] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.578237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.578237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.578237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.578405] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.579086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.579086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.579086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.579086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.579086] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.582642] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-189f9616-2a3c-4fd7-964c-63b93549ef08 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.582642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-189f9616-2a3c-4fd7-964c-63b93549ef08" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.582642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-189f9616-2a3c-4fd7-964c-63b93549ef08" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.582642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-189f9616-2a3c-4fd7-964c-63b93549ef08" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.582642] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('189f9616-2a3c-4fd7-964c-63b93549ef08',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.083105] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.084222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.084340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.084494] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 189f9616-2a3c-4fd7-964c-63b93549ef08 with status ACTIVE [ 1212.084655] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.084758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.084822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.085045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.085140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.085312] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.085411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.085471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.085639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.085704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.085878] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.085966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.086479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.086716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.086796] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.086889] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 189f9616-2a3c-4fd7-964c-63b93549ef08 is going to be updated. [ 1212.109689] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.109961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.110091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.110398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.110549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.110720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-189f9616-2a3c-4fd7-964c-63b93549ef08" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.589574] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.092282] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.094037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.094037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.094037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.094037] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.094037] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1213.130952] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.131141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.131246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.131470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.131619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.142187] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1213.515297] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1213.515668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.516061] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.516134] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.516390] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.516524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.516586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.516757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.516858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.516983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.517138] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.019657] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.019896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.019896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.020145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.020369] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.020588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.020588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.020703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.020778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.021301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.021301] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.021301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.021301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.021301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.021543] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.021543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.021669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.021724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.021797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.021896] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.021988] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.413927] env[61538]: INFO networking_nsxv3.common.synchronization [req-e85fc20d-a89b-4da9-ab89-22b46d2e5516 req-1ee74000-fa7e-47f8-af4b-876b48237837 tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1214.414643] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1214.415235] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.415408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.415543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.415812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.416023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.416163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.416239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.416468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.416572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.416714] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.524374] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d26186c-7b4f-4430-a869-be9595e84fcc: rpc.has_security_group_logging(os_id): False [ 1214.545028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.545412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.545522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.545941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.546099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.546629] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.546817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.546881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.547088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.547268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.547662] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.547815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.547935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.548261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.548584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.548946] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.549151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.549255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.549456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.549557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.549653] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be created. [ 1214.623206] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.623411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.623411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.623757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.623971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.638369] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1214.919291] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.919493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.919540] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.919737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.919835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.920066] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.920171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.920236] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.920442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.920526] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.921081] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be updated. [ 1214.947786] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.947994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.948062] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.948228] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.948378] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.957362] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: IN_PROGRESS for 2s [ 1215.074427] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.074713] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.074826] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.075205] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.075560] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.075794] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.075983] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.076312] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.076488] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.076774] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1215.076923] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1215.077056] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1215.077180] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1215.077336] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1215.077458] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1215.077631] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1215.098302] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1215.098548] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1215.098658] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1215.098866] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-929" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.099169] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.099357] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.099555] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.099836] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.099984] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bd4ffa1-26c1-49ba-b154-0c04a3294c9d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.152150] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1215.152388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.152556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.152832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.153044] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.153167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.153227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.153385] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.153462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.153552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.153644] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.603698] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.604134] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.604134] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.604405] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.604562] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.604730] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 4bd4ffa1-26c1-49ba-b154-0c04a3294c9d not found, creating... [ 1215.605018] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.605189] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.605311] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.605649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.605789] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.606097] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.606327] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.606401] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.606603] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.606738] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.606876] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 4bd4ffa1-26c1-49ba-b154-0c04a3294c9d is going to be created. [ 1215.628743] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.629010] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.629188] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.629553] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.629828] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.630115] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.656352] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.656579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.656630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.656901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.657124] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.657235] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.657302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.657504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.657623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.657741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.657917] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.658039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.658118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.658294] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.658575] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.658665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.658757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.658945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.659055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.659157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.659287] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.161791] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1636da8b-a16b-42d3-874d-5d8471397fd6: rpc.has_security_group_logging(os_id): False [ 1216.182146] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.182360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.182409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.182613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.182755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.183039] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.183150] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.183214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.183401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.183487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.183701] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.183818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.183885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.184063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.184165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.184367] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.184477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.184523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.184686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.184783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.184871] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1216.249510] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.249766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.249766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.249923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.250083] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.264363] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1216.649675] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1216.650141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.732069] env[61538]: INFO networking_nsxv3.common.synchronization [req-4b9d05f9-4427-4d4f-a39d-9fe518d13aa7 req-a0314ceb-d007-4740-8313-af4ded6b9273 tempest-ServerActionsTestOtherB-1077210391 tempest-ServerActionsTestOtherB-1077210391-project-member] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1216.732069] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1216.732069] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.732069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.732069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.732069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.732069] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.732069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.732069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.732476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.732476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.732476] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.909152] env[61538]: INFO networking_nsxv3.common.synchronization [req-e85fc20d-a89b-4da9-ab89-22b46d2e5516 req-7d50bd02-0050-47d1-933d-faafcb3b5682 service nova] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 1216.909410] env[61538]: INFO networking_nsxv3.common.synchronization [req-e85fc20d-a89b-4da9-ab89-22b46d2e5516 req-7d50bd02-0050-47d1-933d-faafcb3b5682 service nova] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1216.909609] env[61538]: INFO networking_nsxv3.common.synchronization [req-e85fc20d-a89b-4da9-ab89-22b46d2e5516 req-7d50bd02-0050-47d1-933d-faafcb3b5682 service nova] Enqueued Resource ID: 4bd4ffa1-26c1-49ba-b154-0c04a3294c9d with Priority: HIGHEST for action port [ 1216.910413] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_rules [ 1216.910599] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1216.910734] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bd4ffa1-26c1-49ba-b154-0c04a3294c9d with Priority: HIGHEST for action port [ 1216.911408] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.911510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.911561] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.911779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.911877] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.913115] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.913277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.913524] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.913641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.913714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.913907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.913987] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bd4ffa1-26c1-49ba-b154-0c04a3294c9d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.974762] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 1216.975062] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 deletion is rescheduled due to dependency. [ 1216.975152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.975386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.975829] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.975945] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.977239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.977239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.977239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.977239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.977239] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.133725] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.133725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.133913] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.134095] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.134381] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.134596] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.134665] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.134877] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.135039] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.135252] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.135370] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.135483] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.135595] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.135738] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.135858] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.135992] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.157310] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.157593] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1217.158631] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.158631] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.158631] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-ff62e994-2e58-433b-884f-5b4fa7639d6b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.158631] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.158631] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.158983] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.159090] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff62e994-2e58-433b-884f-5b4fa7639d6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.235939] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.236160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.236281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.236591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.236705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.236990] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.237147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.237235] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.237422] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.237511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.237720] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1217.266343] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.266535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.266574] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.266915] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.267170] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.277089] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1217.415862] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.415991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.416203] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bd4ffa1-26c1-49ba-b154-0c04a3294c9d with status ACTIVE [ 1217.416372] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.416483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.416601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.416790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.416886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.417076] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.417212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.417254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.417384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.417453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.417877] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.417877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.417877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.418029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.418029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.418095] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bd4ffa1-26c1-49ba-b154-0c04a3294c9d is going to be updated. [ 1217.442729] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.442934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.442934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.443094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.443234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.443402] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bd4ffa1-26c1-49ba-b154-0c04a3294c9d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.479107] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.661910] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.662339] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.662339] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.662593] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.662858] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.663094] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port ff62e994-2e58-433b-884f-5b4fa7639d6b not found, creating... [ 1217.663342] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.663525] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.663685] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.663956] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.664246] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.664584] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.664906] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.665048] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.665309] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.665462] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.665628] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: ff62e994-2e58-433b-884f-5b4fa7639d6b is going to be created. [ 1217.689062] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.689324] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.689405] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.689700] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.689947] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.690193] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.981938] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.277359] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1218.277665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.403584] env[61538]: INFO networking_nsxv3.common.synchronization [req-4b9d05f9-4427-4d4f-a39d-9fe518d13aa7 req-ae36b22d-8214-4c6d-9b76-c40a2515dddb service nova] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 1218.403805] env[61538]: INFO networking_nsxv3.common.synchronization [req-4b9d05f9-4427-4d4f-a39d-9fe518d13aa7 req-ae36b22d-8214-4c6d-9b76-c40a2515dddb service nova] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1218.403980] env[61538]: INFO networking_nsxv3.common.synchronization [req-4b9d05f9-4427-4d4f-a39d-9fe518d13aa7 req-ae36b22d-8214-4c6d-9b76-c40a2515dddb service nova] Enqueued Resource ID: ff62e994-2e58-433b-884f-5b4fa7639d6b with Priority: HIGHEST for action port [ 1218.404596] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 1218.404760] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1218.405373] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff62e994-2e58-433b-884f-5b4fa7639d6b with Priority: HIGHEST for action port [ 1218.405373] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.405373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.405373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.405610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.405722] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.406535] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.406659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.406876] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff62e994-2e58-433b-884f-5b4fa7639d6b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.406981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.407055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.407243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.407318] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff62e994-2e58-433b-884f-5b4fa7639d6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.484146] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.484375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.484523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.484849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.484996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.485171] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be updated. [ 1218.535887] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.536171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.536171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.536365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.536524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.546874] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: IN_PROGRESS for 2s [ 1218.909249] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.909645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.910336] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff62e994-2e58-433b-884f-5b4fa7639d6b with status ACTIVE [ 1218.910460] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.910597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.910692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.910920] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.911044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.911264] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.911399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.911466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.911640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.911730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.911947] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.912082] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.912148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.912323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.912408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.912511] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff62e994-2e58-433b-884f-5b4fa7639d6b is going to be updated. [ 1218.936754] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.936948] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.937201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.937471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.937616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.937782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.286651] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1219.286841] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 deletion is rescheduled due to dependency. [ 1219.286940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.287118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.287343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.287747] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.287747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.287747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.287895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.287895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.287993] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.790583] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.294289] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.557072] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 1220.557072] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.557072] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.557072] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.557340] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.557411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.557496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.557683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.557767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.557853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.557947] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.797148] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.797318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.797384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.797619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.797719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.797821] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1220.830851] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.831055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.831109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.831324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.831449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.843623] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1221.060012] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.564523] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 550dcd2b-7021-4904-a80d-13c93ea25fe6: rpc.has_security_group_logging(os_id): False [ 1221.584871] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.585092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.585155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.585386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.585486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.585998] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.586129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.586193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.586349] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.586435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.586512] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be updated. [ 1221.667446] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.667755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.667843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.668108] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.668317] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.681254] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: IN_PROGRESS for 2s [ 1222.852490] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1222.852852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.852852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.853096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.853309] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.853430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.853496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.853659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.853741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.853827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.853918] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.356523] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.372295] env[61538]: INFO networking_nsxv3.common.synchronization [req-6c2fd8e8-fe90-4750-80f6-ec35f7a21e65 req-2aa72aff-e767-4134-ac7f-f878582a37a6 tempest-DeleteServersTestJSON-890366011 tempest-DeleteServersTestJSON-890366011-project-member] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1223.372295] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGHEST for action security_group_members [ 1223.372589] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.372589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.372735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.373454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.374023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.374023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.374023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.375261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.375261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.375261] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.705028] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 1223.705028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.859954] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e51a7e95-5364-42cc-944f-ced83c3e81b9: rpc.has_security_group_logging(os_id): False [ 1223.879483] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.879483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.879483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.879483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.879483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.879483] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.879483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.879483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.879483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.879483] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.879483] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be updated. [ 1223.886603] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.886603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.886603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.886603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.886603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.886603] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.886603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.886603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.886603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.886603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.887260] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1223.923576] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.923576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.923576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.923576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.923576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.933486] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: IN_PROGRESS for 2s [ 1223.975229] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.975229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.975229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.975229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.975229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.992609] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1224.009049] env[61538]: INFO networking_nsxv3.common.synchronization [req-d7841e31-53b9-40ce-a055-a6257c8889b2 req-97fc98e8-8d23-42de-ae5a-aacda48a28d6 tempest-AttachVolumeTestJSON-1443084926 tempest-AttachVolumeTestJSON-1443084926-project-member] Enqueued Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_members [ 1224.010069] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGHEST for action security_group_members [ 1224.010735] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-b58ef26f-3838-4063-8b99-572a69b4e8cd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.011195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.013030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.013030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.013030] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.013030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.013030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.013030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.013030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.013030] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.518123] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.518123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.518123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.518123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.518123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.518123] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.518123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.518123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.518123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.518123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.518123] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b58ef26f-3838-4063-8b99-572a69b4e8cd is going to be updated. [ 1224.562881] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.562881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.562881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.562881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.562881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.589495] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b58ef26f-3838-4063-8b99-572a69b4e8cd in Status: IN_PROGRESS for 2s [ 1224.806147] env[61538]: INFO networking_nsxv3.common.synchronization [req-71605e2e-74b9-4894-bfa9-3fc013b959e1 req-21880b50-d34e-4b74-8287-5758f19109ce tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1224.806648] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1224.806965] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.807100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.807185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.807363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.807529] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.807631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.807705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.807839] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.807924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.808037] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.311974] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.775718] env[61538]: INFO networking_nsxv3.common.synchronization [None req-c7f8c94f-e165-448e-bffa-d7834ca0877e tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1225.776277] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1225.776599] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.776706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.813897] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.945818] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc in Status: SUCCESS [ 1225.946041] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc deletion is rescheduled due to dependency. [ 1225.946118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.008195] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1226.008462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.197414] env[61538]: INFO networking_nsxv3.common.synchronization [req-0482bbe0-3b0a-4f04-873a-8e56b9f064ba req-07a25da0-0510-4d91-bca6-87d88fb9a323 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1226.197414] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1226.197964] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.197964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.197964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.198210] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.198367] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.198469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.198529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.198709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.199966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.199966] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.316177] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.316560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.316560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.316629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.316730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.316799] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1226.347066] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.347303] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.347378] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.347622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.347810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.357132] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1226.602881] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b58ef26f-3838-4063-8b99-572a69b4e8cd in Status: SUCCESS [ 1226.603154] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b58ef26f-3838-4063-8b99-572a69b4e8cd deletion is rescheduled due to dependency. [ 1226.603242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.701744] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.741163] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.741389] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.741548] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.741863] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.742150] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.742316] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.742450] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.743291] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.743475] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.743973] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.743973] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.743973] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.744154] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.744208] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.744301] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.744439] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.764774] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.764971] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1226.765096] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.765305] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.765726] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-eb87717b-d938-49ad-b113-77d8ae6cfa5b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.765879] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-eb87717b-d938-49ad-b113-77d8ae6cfa5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.766018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-eb87717b-d938-49ad-b113-77d8ae6cfa5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.766366] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-eb87717b-d938-49ad-b113-77d8ae6cfa5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.766509] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb87717b-d938-49ad-b113-77d8ae6cfa5b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.204086] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.268610] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.269119] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.269119] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.269634] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.269724] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.270225] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port eb87717b-d938-49ad-b113-77d8ae6cfa5b not found, creating... [ 1227.270439] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.270683] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.270838] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.271124] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.271676] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.271676] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.271826] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.271902] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.272124] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.272273] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.272453] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: eb87717b-d938-49ad-b113-77d8ae6cfa5b is going to be created. [ 1227.298673] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.298893] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.299918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.299918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.299918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.299918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-eb87717b-d938-49ad-b113-77d8ae6cfa5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.707979] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.707979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.707979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.707979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.707979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.707979] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1227.741502] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.741502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.741502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.741502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.741502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.752723] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1228.191247] env[61538]: INFO networking_nsxv3.common.synchronization [req-0482bbe0-3b0a-4f04-873a-8e56b9f064ba req-5a2fa422-a4b2-428a-95a2-001165ed27d0 service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1228.191363] env[61538]: INFO networking_nsxv3.common.synchronization [req-0482bbe0-3b0a-4f04-873a-8e56b9f064ba req-5a2fa422-a4b2-428a-95a2-001165ed27d0 service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1228.191533] env[61538]: INFO networking_nsxv3.common.synchronization [req-0482bbe0-3b0a-4f04-873a-8e56b9f064ba req-5a2fa422-a4b2-428a-95a2-001165ed27d0 service nova] Enqueued Resource ID: eb87717b-d938-49ad-b113-77d8ae6cfa5b with Priority: HIGHEST for action port [ 1228.191788] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1228.191920] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1228.192026] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb87717b-d938-49ad-b113-77d8ae6cfa5b with Priority: HIGHEST for action port [ 1228.192601] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.192753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.192871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.193039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.193124] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.193996] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.194117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.194325] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb87717b-d938-49ad-b113-77d8ae6cfa5b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.194429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb87717b-d938-49ad-b113-77d8ae6cfa5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.194504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb87717b-d938-49ad-b113-77d8ae6cfa5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.194675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb87717b-d938-49ad-b113-77d8ae6cfa5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.194758] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb87717b-d938-49ad-b113-77d8ae6cfa5b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.368318] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1228.368601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.368823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.369224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.369602] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.369810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.369913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.370157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.370331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.372596] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.696614] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.696816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.697050] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb87717b-d938-49ad-b113-77d8ae6cfa5b with status ACTIVE [ 1228.697351] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.697426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.697469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.697688] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.697842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.698017] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.698073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.698118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.698272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.698356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.698555] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.698642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.698704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.698849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.698929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.699082] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb87717b-d938-49ad-b113-77d8ae6cfa5b is going to be updated. [ 1228.721487] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.721794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.721794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.721968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.722123] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.722321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb87717b-d938-49ad-b113-77d8ae6cfa5b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.872448] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.872655] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.872709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.872954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.873066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.873295] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.873399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.873466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.873656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.873750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.873904] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1228.915223] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.915445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.915445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.915626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.915767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.926466] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1229.765911] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1229.766285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.766285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.766506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.766698] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.766824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.766898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.767028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.767096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.767199] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.269899] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.776403] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.939101] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1230.939301] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 deletion is rescheduled due to dependency. [ 1230.939421] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.278384] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.278578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.278633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.279059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.279240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.279439] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1231.317850] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.318022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.318077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.318305] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.318536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.330326] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1233.193403] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1233.193794] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1233.341939] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1233.342281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.342498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.342757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.343041] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.343171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.343293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.345029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.345029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.345029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.345029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.782942] env[61538]: INFO networking_nsxv3.common.synchronization [None req-e3671314-92be-481f-975b-73f1f523adb4 None None] Enqueued Resource ID: 37e75afa-1f2f-46f8-a782-8e9847b92bf8 with Priority: HIGHEST for action port [ 1233.783509] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37e75afa-1f2f-46f8-a782-8e9847b92bf8 with Priority: HIGHEST for action port [ 1233.784744] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-37e75afa-1f2f-46f8-a782-8e9847b92bf8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.784744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37e75afa-1f2f-46f8-a782-8e9847b92bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.784744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37e75afa-1f2f-46f8-a782-8e9847b92bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.784744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37e75afa-1f2f-46f8-a782-8e9847b92bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.784744] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37e75afa-1f2f-46f8-a782-8e9847b92bf8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.846488] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.846653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.846727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.846968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.847177] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.847901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.847901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.847901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.847901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.847901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.847901] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.847901] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.848181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.848181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.848235] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.848323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.848670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.848670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.848758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.848844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.848926] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.287185] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37e75afa-1f2f-46f8-a782-8e9847b92bf8 [ 1234.287185] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.287716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.287716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.287716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.287716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.287839] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37e75afa-1f2f-46f8-a782-8e9847b92bf8 already deleted. [ 1234.287882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37e75afa-1f2f-46f8-a782-8e9847b92bf8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.352515] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d26186c-7b4f-4430-a869-be9595e84fcc: rpc.has_security_group_logging(os_id): False [ 1234.373509] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.373648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.373648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.374704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.374704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.374704] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.374704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.374704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.374704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.374704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.375027] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.375027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.375027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.375027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.375152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.375979] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.375979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.375979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.375979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.375979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.375979] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1234.443258] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.443425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.443507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.445309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.445309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.460966] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1235.285582] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.285848] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.285980] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.286415] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.286630] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.286797] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.286916] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.287174] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.287391] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.287675] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.287675] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.287791] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.287890] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.288022] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.288143] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.288366] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.306299] env[61538]: INFO networking_nsxv3.common.synchronization [req-85e4d083-ce61-4b5b-a5f3-c66fcd69242f req-2ff8de0e-2250-414d-84fb-d401c98a7c61 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_members [ 1235.307034] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936eb902-9d4d-4db7-a735-4f3a5141250f with Priority: HIGHEST for action security_group_members [ 1235.307591] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-936eb902-9d4d-4db7-a735-4f3a5141250f taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.307712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.307767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.307974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.308163] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.308267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.308331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.308489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.308609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.308719] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('936eb902-9d4d-4db7-a735-4f3a5141250f',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.312599] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.312779] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1235.312988] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.313175] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-692" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.313491] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.313695] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.313805] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.314077] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.314223] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e06d5cf8-450e-488f-8ba6-9e7d62811ba1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.814075] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.814075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.814075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.814075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.814075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.814075] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.814075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.814075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.814075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.814075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.814075] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 936eb902-9d4d-4db7-a735-4f3a5141250f is going to be updated. [ 1235.816915] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.817169] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.817369] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.817548] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.817702] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.817988] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.818176] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.818305] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.818524] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.818687] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.819502] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.819722] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.820153] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.820153] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.820239] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.820373] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: e06d5cf8-450e-488f-8ba6-9e7d62811ba1 is going to be updated. [ 1235.843158] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.843476] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.843682] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.844158] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.844315] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.844554] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.846721] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.846861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.846904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.847105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.847598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.856702] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 936eb902-9d4d-4db7-a735-4f3a5141250f in Status: IN_PROGRESS for 2s [ 1235.968538] env[61538]: INFO networking_nsxv3.common.synchronization [None req-1fd7d318-fc63-4685-8f50-0a5d763919ee None None] Enqueued Resource ID: 17c21a5e-55a7-4c6b-9eae-7b403cf163cc with Priority: HIGHEST for action port [ 1235.970054] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17c21a5e-55a7-4c6b-9eae-7b403cf163cc with Priority: HIGHEST for action port [ 1235.970054] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-17c21a5e-55a7-4c6b-9eae-7b403cf163cc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.970054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17c21a5e-55a7-4c6b-9eae-7b403cf163cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.970054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17c21a5e-55a7-4c6b-9eae-7b403cf163cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.970054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17c21a5e-55a7-4c6b-9eae-7b403cf163cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.970323] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17c21a5e-55a7-4c6b-9eae-7b403cf163cc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.472947] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17c21a5e-55a7-4c6b-9eae-7b403cf163cc [ 1236.472947] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.472947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.472947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.473396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.473396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.473607] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17c21a5e-55a7-4c6b-9eae-7b403cf163cc already deleted. [ 1236.473810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17c21a5e-55a7-4c6b-9eae-7b403cf163cc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.475074] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1236.476024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.569050] env[61538]: INFO networking_nsxv3.common.synchronization [req-4d6c4403-1587-4897-af76-d0f666e78244 req-2f838451-9f9b-4cac-a33d-5dd3b36fd462 service nova] Enqueued Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_rules [ 1236.569050] env[61538]: INFO networking_nsxv3.common.synchronization [req-4d6c4403-1587-4897-af76-d0f666e78244 req-2f838451-9f9b-4cac-a33d-5dd3b36fd462 service nova] Enqueued Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_members [ 1236.569050] env[61538]: INFO networking_nsxv3.common.synchronization [req-4d6c4403-1587-4897-af76-d0f666e78244 req-2f838451-9f9b-4cac-a33d-5dd3b36fd462 service nova] Enqueued Resource ID: e06d5cf8-450e-488f-8ba6-9e7d62811ba1 with Priority: HIGHEST for action port [ 1236.569050] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_rules [ 1236.569050] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_members [ 1236.569050] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e06d5cf8-450e-488f-8ba6-9e7d62811ba1 with Priority: HIGHEST for action port [ 1236.569637] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.569766] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.569833] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.570121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.570163] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.571673] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.571804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.571876] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.572077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.572236] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.572330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.572392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.572534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.572618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.573349] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.573887] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.573887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.573887] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.574316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.574316] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e06d5cf8-450e-488f-8ba6-9e7d62811ba1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.076619] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.076844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.077108] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.078172] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e06d5cf8-450e-488f-8ba6-9e7d62811ba1 with status ACTIVE [ 1237.078408] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.078769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.078769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.078898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.078993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.080031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.080031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.080031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.080031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.080031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.080031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.080031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.080370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.080370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.080370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.080521] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e06d5cf8-450e-488f-8ba6-9e7d62811ba1 is going to be updated. [ 1237.106536] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.106536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.106536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.106768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.106959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.107199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e06d5cf8-450e-488f-8ba6-9e7d62811ba1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.582454] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.866214] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 936eb902-9d4d-4db7-a735-4f3a5141250f in Status: SUCCESS [ 1237.866401] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 936eb902-9d4d-4db7-a735-4f3a5141250f deletion is rescheduled due to dependency. [ 1237.866517] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-936eb902-9d4d-4db7-a735-4f3a5141250f" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.084786] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.085103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.085239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.085615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.085797] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.085981] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6585f491-6358-4615-a571-0639903266ae is going to be updated. [ 1238.120693] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.120932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.121042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.121361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.121631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.132661] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6585f491-6358-4615-a571-0639903266ae in Status: IN_PROGRESS for 2s [ 1239.249740] env[61538]: INFO networking_nsxv3.common.synchronization [req-dadcdd80-a581-4141-97ef-6e8f3d292c86 req-3966cf28-964f-4449-9fc7-a722145397f6 tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1239.249740] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1239.249740] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.249740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.250316] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.250431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.250550] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.250697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.250738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.251436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.251436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.251436] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.678144] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.678379] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.678471] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.678891] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.679175] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.679392] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.679452] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.680719] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.680719] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.680864] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.680953] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1239.681061] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1239.681196] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1239.681323] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.681936] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1239.681936] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1239.702218] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1239.702831] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1239.702831] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1239.703115] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.703321] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-1df49c85-dd94-41c4-9c7d-d7df50f0288d taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.703553] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-1df49c85-dd94-41c4-9c7d-d7df50f0288d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.703642] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-1df49c85-dd94-41c4-9c7d-d7df50f0288d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.704270] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-1df49c85-dd94-41c4-9c7d-d7df50f0288d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.704270] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1df49c85-dd94-41c4-9c7d-d7df50f0288d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.757029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.757029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.757029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.757029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.757029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.757029] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.757029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.757029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.757029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.757029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.757029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e already deleted. [ 1239.757029] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.759078] env[61538]: INFO networking_nsxv3.common.synchronization [req-42c7a004-aa6b-46e7-a642-fd297ffc8294 req-bdd83d74-9c92-451f-94dc-c84b8830708b tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1239.760300] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1239.761170] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.761436] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.761697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.762047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.762327] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.762573] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.762754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.763034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.763243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.763438] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.144512] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6585f491-6358-4615-a571-0639903266ae in Status: SUCCESS [ 1240.144761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.144935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.145178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.145381] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.145498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.145556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.145706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.145790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.145875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.145987] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.209451] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.209667] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.209837] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.210217] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.210476] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.210737] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 1df49c85-dd94-41c4-9c7d-d7df50f0288d not found, creating... [ 1240.211072] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.211267] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.211399] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.211690] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.211891] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.212282] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.212509] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.212677] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.213030] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.213169] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.213360] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 1df49c85-dd94-41c4-9c7d-d7df50f0288d is going to be created. [ 1240.254244] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.254244] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.254896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.254896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.254896] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.255096] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-1df49c85-dd94-41c4-9c7d-d7df50f0288d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.265998] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.649983] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.768849] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.142072] env[61538]: INFO networking_nsxv3.common.synchronization [req-3f913548-3330-4079-8926-8ea510fa6a37 req-a9aa7324-88f1-45d3-97dc-0e9a5e31b1c1 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_members [ 1241.142820] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGHEST for action security_group_members [ 1241.145340] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-afd82025-936e-45a1-900c-5fcd4bb713ea taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.145340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.145340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.145340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.145340] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.145340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.145340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.145340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.145340] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.145340] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.153341] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6585f491-6358-4615-a571-0639903266ae: rpc.has_security_group_logging(os_id): False [ 1241.174042] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.174042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.174042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.174042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.174042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.174042] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.174042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.174042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.174042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.174042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.174042] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6585f491-6358-4615-a571-0639903266ae is going to be updated. [ 1241.243506] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.243506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.243506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.243506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.243506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.258308] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6585f491-6358-4615-a571-0639903266ae in Status: IN_PROGRESS for 2s [ 1241.274039] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.274039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.274039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.274039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.274039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.274039] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1241.276912] env[61538]: INFO networking_nsxv3.common.synchronization [req-dadcdd80-a581-4141-97ef-6e8f3d292c86 req-23038f72-bf08-4fa2-826d-f57acbd7a76a service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1241.277297] env[61538]: INFO networking_nsxv3.common.synchronization [req-dadcdd80-a581-4141-97ef-6e8f3d292c86 req-23038f72-bf08-4fa2-826d-f57acbd7a76a service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1241.277746] env[61538]: INFO networking_nsxv3.common.synchronization [req-dadcdd80-a581-4141-97ef-6e8f3d292c86 req-23038f72-bf08-4fa2-826d-f57acbd7a76a service nova] Enqueued Resource ID: 1df49c85-dd94-41c4-9c7d-d7df50f0288d with Priority: HIGHEST for action port [ 1241.279267] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1241.279550] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1241.279786] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1df49c85-dd94-41c4-9c7d-d7df50f0288d with Priority: HIGHEST for action port [ 1241.280272] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.283166] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.283166] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.283166] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.283166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.283166] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.287172] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-1df49c85-dd94-41c4-9c7d-d7df50f0288d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.287172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1df49c85-dd94-41c4-9c7d-d7df50f0288d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.287172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1df49c85-dd94-41c4-9c7d-d7df50f0288d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.287172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1df49c85-dd94-41c4-9c7d-d7df50f0288d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.287172] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1df49c85-dd94-41c4-9c7d-d7df50f0288d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.310026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.310026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.310026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.310026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.310026] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.325741] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1241.647503] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.647649] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.647717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.647951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.648066] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.648278] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.648381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.648451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.648673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.648757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.648792] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afd82025-936e-45a1-900c-5fcd4bb713ea is going to be updated. [ 1241.683101] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.683366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.683366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.683655] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.683696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.694050] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afd82025-936e-45a1-900c-5fcd4bb713ea in Status: IN_PROGRESS for 2s [ 1241.788057] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.790279] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.790279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.790279] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1df49c85-dd94-41c4-9c7d-d7df50f0288d with status ACTIVE [ 1241.790279] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.790279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.790279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.790279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.790279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.790279] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.790279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.790279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.790279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.790279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.790279] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.790881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.790881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.790881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.790881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.790881] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1df49c85-dd94-41c4-9c7d-d7df50f0288d is going to be updated. [ 1241.818188] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.818795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.818795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.818795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.818795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.818958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1df49c85-dd94-41c4-9c7d-d7df50f0288d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.146629] env[61538]: INFO networking_nsxv3.common.synchronization [None req-d535fbed-6ddc-49f2-81d8-7d6689658d97 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_rules [ 1242.147220] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_rules [ 1242.147535] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.147664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.147733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.147989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.148423] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.217787] env[61538]: INFO networking_nsxv3.common.synchronization [None req-34486d74-6e4e-4ac2-99c2-bbc244024a43 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_rules [ 1242.219051] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_rules [ 1242.219051] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.219225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.293218] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.692550] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.692825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.692940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.693292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.693445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.693583] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a445d437-8661-4393-ac08-d6abd23acc36 already deleted. [ 1242.693702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.693951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.694343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.694343] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.797720] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.797918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.797979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.800480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.800480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.800480] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be created. [ 1242.833985] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.834186] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.834360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.834448] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.834613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.847775] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: UNINITIALIZED for 2s [ 1243.218709] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.220112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.220112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.220112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.220112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.220112] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a445d437-8661-4393-ac08-d6abd23acc36 already deleted. [ 1243.220112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.277253] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6585f491-6358-4615-a571-0639903266ae in Status: SUCCESS [ 1243.277253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.338683] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1243.339060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.705407] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afd82025-936e-45a1-900c-5fcd4bb713ea in Status: SUCCESS [ 1243.705599] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afd82025-936e-45a1-900c-5fcd4bb713ea deletion is rescheduled due to dependency. [ 1243.705723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.858642] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1244.859039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.859135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.859359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.859613] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.859699] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.859751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.859895] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.859976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.860079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.860174] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.362317] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.362540] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.362589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.362877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.363072] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.363200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.363267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.363459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.363553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.363639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.363788] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.363902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.363962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.364116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.364256] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.364370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.364432] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.364568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.364645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.364726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.364837] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.867138] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 685f27e5-d19d-4490-b97e-a0015776b51e: rpc.has_security_group_logging(os_id): False [ 1245.886790] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.886790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.886790] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.887445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.887445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.887445] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.887445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.887653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.887653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.887718] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.887882] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.887992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.887992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.888169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.888263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.888463] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.888605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.888605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.888769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.888769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.888942] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be created. [ 1245.959227] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.959227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.959227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.959227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.959227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.971544] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1247.219749] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1247.220125] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1247.987622] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1247.987919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.730245] env[61538]: INFO networking_nsxv3.common.synchronization [req-a7b29daf-d422-4cac-9c1e-43a4433a7b66 req-a3f3a5c9-f9ad-41ed-972f-ab1d6a461bd2 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1249.730787] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1249.731152] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.731282] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.731350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.731603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.731781] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.731893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.731990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.732159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.732259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.732355] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.123842] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.124066] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.124199] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.124479] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.124744] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.124907] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.125041] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.125302] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.125462] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.125699] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.125828] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1250.125944] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1250.126074] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1250.126194] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.126309] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1250.126449] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1250.146443] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1250.146618] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1250.146770] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1250.146966] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.147311] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.147497] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.147623] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.147957] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.148125] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.236352] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.236352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.236352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.236620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.236620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.236847] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.236951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.236985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.237146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.237223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.237312] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a445d437-8661-4393-ac08-d6abd23acc36 already deleted. [ 1250.237387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.650244] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.650523] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.650663] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.651144] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.651325] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.651492] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9 not found, creating... [ 1250.651787] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.652128] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.652276] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.652545] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.652700] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.653042] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.653250] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.653459] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.653754] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.653923] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.654091] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9 is going to be created. [ 1250.676246] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.676479] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.676612] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.676911] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.677169] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.677401] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.392570] env[61538]: INFO networking_nsxv3.common.synchronization [req-a7b29daf-d422-4cac-9c1e-43a4433a7b66 req-8c002aff-701b-4f6e-bb2b-7b7909ee3d58 service nova] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_rules [ 1251.392851] env[61538]: INFO networking_nsxv3.common.synchronization [req-a7b29daf-d422-4cac-9c1e-43a4433a7b66 req-8c002aff-701b-4f6e-bb2b-7b7909ee3d58 service nova] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1251.393692] env[61538]: INFO networking_nsxv3.common.synchronization [req-a7b29daf-d422-4cac-9c1e-43a4433a7b66 req-8c002aff-701b-4f6e-bb2b-7b7909ee3d58 service nova] Enqueued Resource ID: 3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9 with Priority: HIGHEST for action port [ 1251.394466] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_rules [ 1251.394711] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1251.394900] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9 with Priority: HIGHEST for action port [ 1251.395331] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.395596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.395751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.396094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.396692] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.397859] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.398079] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.398218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.398506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.398761] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.398946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.399083] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.399325] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.399497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.399646] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.400856] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.400856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.401028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.401297] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.401414] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.903111] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.903321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.903518] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.906226] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9 with status ACTIVE [ 1251.906226] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.906226] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.906226] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.906226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.906226] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9 is going to be updated. [ 1251.929224] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.929445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.929445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.930945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.930945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.930945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a7d71d2-6873-48b1-8e3f-5b6ca398f5c9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.033563] env[61538]: INFO networking_nsxv3.common.synchronization [req-291d864b-1405-486c-8808-17f7415077c3 req-ef0205e0-0e8b-4dfe-a3e9-bee4c8ecf2ac tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1252.034114] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1252.034426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.034560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.034680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.034805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.034954] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.035096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.035160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.035298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.035384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.035477] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.365065] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.365341] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.365528] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.365851] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.366197] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.366443] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.366640] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.366922] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.367151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.367420] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1252.367594] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1252.367749] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1252.367908] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1252.368096] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1252.368262] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1252.368447] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1252.386703] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1252.387027] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1252.387228] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1252.387471] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.387842] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-fd769309-365b-44c3-a088-5d1dc94d9e5a taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.388092] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-fd769309-365b-44c3-a088-5d1dc94d9e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.388280] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-fd769309-365b-44c3-a088-5d1dc94d9e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.388674] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-fd769309-365b-44c3-a088-5d1dc94d9e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.388923] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd769309-365b-44c3-a088-5d1dc94d9e5a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.407959] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.537303] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.891031] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.891218] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.891278] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.891579] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.891884] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.891961] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port fd769309-365b-44c3-a088-5d1dc94d9e5a not found, creating... [ 1252.892219] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.892918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.892918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.892918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.892918] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.893186] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.893325] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.893430] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.893649] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.893771] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.893916] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: fd769309-365b-44c3-a088-5d1dc94d9e5a is going to be created. [ 1252.910153] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.910445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.910445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.910650] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.910723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.910839] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a445d437-8661-4393-ac08-d6abd23acc36 is going to be created. [ 1252.919558] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.919991] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.919991] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.920275] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.920525] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.920758] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-fd769309-365b-44c3-a088-5d1dc94d9e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.937101] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.937425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.937425] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.937623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.937776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.954073] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: UNINITIALIZED for 2s [ 1253.039628] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.541960] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.542333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.542333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.542426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.542521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.542625] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1253.589522] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.589522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.589825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.589825] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.589904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.600690] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1253.655551] env[61538]: INFO networking_nsxv3.common.synchronization [req-291d864b-1405-486c-8808-17f7415077c3 req-6c683050-cd02-4bf2-99ec-971692ff2d62 service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1253.655732] env[61538]: INFO networking_nsxv3.common.synchronization [req-291d864b-1405-486c-8808-17f7415077c3 req-6c683050-cd02-4bf2-99ec-971692ff2d62 service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1253.655874] env[61538]: INFO networking_nsxv3.common.synchronization [req-291d864b-1405-486c-8808-17f7415077c3 req-6c683050-cd02-4bf2-99ec-971692ff2d62 service nova] Enqueued Resource ID: fd769309-365b-44c3-a088-5d1dc94d9e5a with Priority: HIGHEST for action port [ 1253.656195] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1253.656331] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1253.656422] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd769309-365b-44c3-a088-5d1dc94d9e5a with Priority: HIGHEST for action port [ 1253.657098] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.657313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.657313] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.657446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.657528] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.658761] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.658761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.658989] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd769309-365b-44c3-a088-5d1dc94d9e5a taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.659107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd769309-365b-44c3-a088-5d1dc94d9e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.659176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd769309-365b-44c3-a088-5d1dc94d9e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.659442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd769309-365b-44c3-a088-5d1dc94d9e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.659546] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd769309-365b-44c3-a088-5d1dc94d9e5a',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.162227] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.162684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.162996] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd769309-365b-44c3-a088-5d1dc94d9e5a with status ACTIVE [ 1254.163279] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.163443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.163554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.163852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.163979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.164942] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.165153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.165264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.165567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.165641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.165924] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.166118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.166230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.166462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.166598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.166742] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd769309-365b-44c3-a088-5d1dc94d9e5a is going to be updated. [ 1254.191707] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.191925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.191925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.192202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.192332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.192516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd769309-365b-44c3-a088-5d1dc94d9e5a" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.382627] env[61538]: INFO networking_nsxv3.common.synchronization [req-a45bfe7b-4018-4008-b722-b9472789b02b req-7569ba5b-77cb-4e64-932b-e41e3d2973b0 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1254.383268] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1254.383543] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.383665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.383723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.383911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.384284] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.384407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.384493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.384623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.384712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.384810] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.668597] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.669040] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.669040] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.669327] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.669641] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.669849] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.670017] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.670244] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.670409] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.670624] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.670890] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.670954] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.671078] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.671199] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.671326] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.671516] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.691012] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.691231] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1254.691379] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.691570] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.691928] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-30b017cf-ed19-4ecc-a917-33a9eff869e2 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.692134] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.692262] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.692572] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.692720] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30b017cf-ed19-4ecc-a917-33a9eff869e2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.887028] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.887028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.887028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.887383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.910692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.911053] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.911344] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.911504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.912048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.912177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.912285] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb is going to be updated. [ 1254.938683] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.938846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.938897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.939105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.939252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.948660] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: IN_PROGRESS for 2s [ 1254.962124] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: SUCCESS [ 1254.962328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.962481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.962686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.962872] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.962991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.963068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.963220] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.963302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.963388] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.963478] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.195018] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.195210] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.195344] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.195638] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.195796] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.195958] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 30b017cf-ed19-4ecc-a917-33a9eff869e2 not found, creating... [ 1255.196241] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.196404] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.196525] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.196741] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.196887] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.197207] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.197373] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.197497] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.197708] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.197873] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.197999] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 30b017cf-ed19-4ecc-a917-33a9eff869e2 is going to be created. [ 1255.217424] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.217622] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.217752] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.218049] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.218289] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.218515] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.466104] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.555640] env[61538]: INFO networking_nsxv3.common.synchronization [req-bd3908ab-f505-4f77-a98e-9620d56cc29d req-c0027ce6-1d1d-4a8c-b5e0-9233477c3c28 tempest-AttachVolumeNegativeTest-966914432 tempest-AttachVolumeNegativeTest-966914432-project-member] Enqueued Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_members [ 1255.556827] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGHEST for action security_group_members [ 1255.557275] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-186c4c09-0cac-4aaf-99ba-5ef21930c905 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.557524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.557741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.558121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.558366] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.558585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.558798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.559112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.559396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.559684] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.612362] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1255.612603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.612774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.613097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.613310] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.613438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.613505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.613669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.613753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.614397] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.970141] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a445d437-8661-4393-ac08-d6abd23acc36: rpc.has_security_group_logging(os_id): False [ 1255.990473] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.990473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.990473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.990473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.990473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.990473] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.990473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.990473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.990473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.990473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.990473] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a445d437-8661-4393-ac08-d6abd23acc36 is going to be created. [ 1256.069581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.069581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.069581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.069581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.069581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.069581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.069581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.069581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.069581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.069581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.069581] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 is going to be updated. [ 1256.073173] env[61538]: INFO networking_nsxv3.common.synchronization [req-a45bfe7b-4018-4008-b722-b9472789b02b req-78fef08d-593d-4707-bbaf-7d49fc868a84 service nova] Enqueued Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_rules [ 1256.073389] env[61538]: INFO networking_nsxv3.common.synchronization [req-a45bfe7b-4018-4008-b722-b9472789b02b req-78fef08d-593d-4707-bbaf-7d49fc868a84 service nova] Enqueued Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1256.073608] env[61538]: INFO networking_nsxv3.common.synchronization [req-a45bfe7b-4018-4008-b722-b9472789b02b req-78fef08d-593d-4707-bbaf-7d49fc868a84 service nova] Enqueued Resource ID: 30b017cf-ed19-4ecc-a917-33a9eff869e2 with Priority: HIGHEST for action port [ 1256.074288] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_rules [ 1256.074423] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1256.074517] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b017cf-ed19-4ecc-a917-33a9eff869e2 with Priority: HIGHEST for action port [ 1256.075452] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.075593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.075653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.075844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.075929] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.076893] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.077028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.077235] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-30b017cf-ed19-4ecc-a917-33a9eff869e2 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.077358] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.077426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.078039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.078039] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30b017cf-ed19-4ecc-a917-33a9eff869e2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.117733] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.141416] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.141416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.141704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.141704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.141832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.152710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.152877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.152925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.153163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.153420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.155354] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 in Status: IN_PROGRESS for 2s [ 1256.163914] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: IN_PROGRESS for 2s [ 1256.579337] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.579583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.579805] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30b017cf-ed19-4ecc-a917-33a9eff869e2 with status ACTIVE [ 1256.579983] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.580148] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.580234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.580471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.580592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.580791] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.580957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.581080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.581269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.581374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.581583] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.581707] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.581808] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.582025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.582140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.582233] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30b017cf-ed19-4ecc-a917-33a9eff869e2 is going to be updated. [ 1256.616810] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.616810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.616810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.616810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.617155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.617234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.619744] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.962601] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: SUCCESS [ 1256.962601] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb deletion is rescheduled due to dependency. [ 1256.962601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.962601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.962601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.962923] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.962923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.962923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.963045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.963075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.963157] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.122343] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.122749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.122749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.122855] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.122975] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.123034] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1257.162524] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.162735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.162735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.162935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.163100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.174468] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1257.466205] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.968352] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.165235] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 in Status: SUCCESS [ 1258.165608] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 deletion is rescheduled due to dependency. [ 1258.165608] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.184780] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: SUCCESS [ 1258.185095] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.470894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.471117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.471165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.471396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.471523] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.471680] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb is going to be updated. [ 1258.504751] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.504974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.504974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.505196] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.505350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.521534] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: IN_PROGRESS for 2s [ 1259.189295] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1259.189705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.189705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.189951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.190213] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.190402] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.190402] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.190584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.190692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.190784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.190910] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.693842] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.694086] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.694183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.694539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.694802] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.694958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.695133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.695308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.695449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.695569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.695729] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.695826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.695890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.696044] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.696184] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.696275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.696332] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.696468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.696542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.696620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.696710] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.198670] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d26186c-7b4f-4430-a869-be9595e84fcc: rpc.has_security_group_logging(os_id): False [ 1260.216731] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.216924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.216974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.217211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.217319] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.217561] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.217672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.217735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.217908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.217998] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.218193] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.218295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.218356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.218507] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.218592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.218791] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.218932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.219161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.219341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.219429] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.219527] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1260.289130] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.289375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.289375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.289557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.289701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.309088] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1260.534660] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: SUCCESS [ 1260.535060] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.535131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.535320] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.535519] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.536430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.536430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.536430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.536430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.536430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.536430] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.045019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.045019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.045019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.045019] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.045019] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.045680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.045680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.045680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.045680] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.045680] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.076129] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1261.076357] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1261.547851] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d15333c-499a-45ad-a20b-dad70f7f90bb: rpc.has_security_group_logging(os_id): False [ 1261.567215] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.567370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.567443] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.567659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.567753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.568037] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.568149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.568218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.568360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.568435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.568626] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.568731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.568809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.569010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.569010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.569149] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.569241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.569301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.569442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.569511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.569590] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb is going to be updated. [ 1261.634174] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.634331] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.634383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.634603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.634751] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.647933] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: IN_PROGRESS for 2s [ 1262.324575] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1262.324809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.661559] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: SUCCESS [ 1263.661910] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.740174] env[61538]: INFO networking_nsxv3.common.synchronization [req-601a5f85-de1c-40b4-9c0c-b65ee81634a3 req-449a5bf2-c9ec-4f77-970f-50aa47acf6d4 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1265.740741] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1265.741174] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.741309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.741491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.741728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.742017] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.742248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.742351] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.742556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.742675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.742799] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.246181] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.253023] env[61538]: INFO networking_nsxv3.common.synchronization [req-908b90e9-3422-4e23-b2ae-0875ac856cf3 req-07273463-6c3e-4019-b483-dafdc2462728 tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1266.253023] env[61538]: INFO networking_nsxv3.common.synchronization [req-3922815b-af52-4b38-b68f-d317d2e37316 req-26e778c0-0114-48bf-9a8c-ba9ec9c2dcd6 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1266.253658] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1266.253658] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb with Priority: HIGHEST for action security_group_members [ 1266.255853] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.255853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.255853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.255853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.255853] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.255853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.255853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.255853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.255853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.255853] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.255853] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d15333c-499a-45ad-a20b-dad70f7f90bb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.255853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.255853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.256413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.256413] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.256413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.256413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.256413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.256413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.256597] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d15333c-499a-45ad-a20b-dad70f7f90bb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.323918] env[61538]: INFO networking_nsxv3.common.synchronization [req-3922815b-af52-4b38-b68f-d317d2e37316 req-26e778c0-0114-48bf-9a8c-ba9ec9c2dcd6 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: 30b017cf-ed19-4ecc-a917-33a9eff869e2 with Priority: HIGHEST for action port [ 1266.324625] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b017cf-ed19-4ecc-a917-33a9eff869e2 with Priority: HIGHEST for action port [ 1266.327099] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-30b017cf-ed19-4ecc-a917-33a9eff869e2 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.327330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.327862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.328198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.328342] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30b017cf-ed19-4ecc-a917-33a9eff869e2',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.748545] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.758563] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.758791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.758847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.759091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.759196] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.759410] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.759499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.759567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.759738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.759806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.759893] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1266.761196] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.761312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.761381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.761538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.761616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.761793] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.761884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.761952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.762216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.762216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.762288] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb is going to be updated. [ 1266.813727] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.813727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.813727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.814106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.814310] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.816379] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.816551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.816604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.816812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.816964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.827804] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: IN_PROGRESS for 2s [ 1266.828740] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1266.832076] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30b017cf-ed19-4ecc-a917-33a9eff869e2 with status ACTIVE [ 1266.832268] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.832415] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.832481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.832704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.832930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.833131] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.833246] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.833306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.833490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.833558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.833769] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.833866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.833927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.834105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.834179] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.834264] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30b017cf-ed19-4ecc-a917-33a9eff869e2 is going to be updated. [ 1266.860990] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.861225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.861323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.861559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.861705] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.861886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30b017cf-ed19-4ecc-a917-33a9eff869e2" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.163940] env[61538]: INFO networking_nsxv3.common.synchronization [req-fff8b99f-4c5b-48dd-b479-b3f8ef0823f0 req-504cb0db-3b2c-46b9-b0b3-c8215569bb7b tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1267.164534] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1267.164845] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.164971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.165055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.165259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.165415] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.165514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.165575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.165714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.165800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.165896] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.251103] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.251286] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.251359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.251719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.251849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.251985] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1267.286962] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.287131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.287184] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.287404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.287552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.297505] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1267.530719] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.530719] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.530904] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.531302] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.531596] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.533976] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.533976] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.533976] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.533976] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.533976] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1267.533976] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1267.533976] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1267.533976] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1267.533976] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1267.533976] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1267.533976] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1267.559867] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1267.560072] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1267.560228] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1267.560485] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.561332] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-735d1ad5-27dd-48fe-9d11-abc15c2f647b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.561544] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-735d1ad5-27dd-48fe-9d11-abc15c2f647b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.561795] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-735d1ad5-27dd-48fe-9d11-abc15c2f647b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.562332] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-735d1ad5-27dd-48fe-9d11-abc15c2f647b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.562436] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('735d1ad5-27dd-48fe-9d11-abc15c2f647b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.668039] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.065613] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.066028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.066028] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.066207] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.066389] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.066557] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 735d1ad5-27dd-48fe-9d11-abc15c2f647b not found, creating... [ 1268.066958] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.067074] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.067118] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.067344] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.067489] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.067774] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.067978] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.068124] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.068340] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.068484] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.068629] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 735d1ad5-27dd-48fe-9d11-abc15c2f647b is going to be created. [ 1268.091439] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.091675] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.091788] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.092122] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.092409] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.092650] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-735d1ad5-27dd-48fe-9d11-abc15c2f647b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.170354] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.674594] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.674594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.674594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.674594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.674594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.674594] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a445d437-8661-4393-ac08-d6abd23acc36 is going to be updated. [ 1268.704107] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.704107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.704107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.704107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.704107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.712806] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: IN_PROGRESS for 2s [ 1268.843553] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1268.843553] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e deletion is rescheduled due to dependency. [ 1268.843553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.843553] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb in Status: SUCCESS [ 1268.843553] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d15333c-499a-45ad-a20b-dad70f7f90bb deletion is rescheduled due to dependency. [ 1268.843553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d15333c-499a-45ad-a20b-dad70f7f90bb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.131641] env[61538]: INFO networking_nsxv3.common.synchronization [req-fff8b99f-4c5b-48dd-b479-b3f8ef0823f0 req-6bb7b964-a866-41d6-951a-948dd5c88172 service nova] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_rules [ 1269.131641] env[61538]: INFO networking_nsxv3.common.synchronization [req-fff8b99f-4c5b-48dd-b479-b3f8ef0823f0 req-6bb7b964-a866-41d6-951a-948dd5c88172 service nova] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1269.131641] env[61538]: INFO networking_nsxv3.common.synchronization [req-fff8b99f-4c5b-48dd-b479-b3f8ef0823f0 req-6bb7b964-a866-41d6-951a-948dd5c88172 service nova] Enqueued Resource ID: 735d1ad5-27dd-48fe-9d11-abc15c2f647b with Priority: HIGHEST for action port [ 1269.131641] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_rules [ 1269.131641] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1269.131641] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735d1ad5-27dd-48fe-9d11-abc15c2f647b with Priority: HIGHEST for action port [ 1269.132588] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.132912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.133091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.133405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.133589] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.135795] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.136042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.136545] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-735d1ad5-27dd-48fe-9d11-abc15c2f647b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.136986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-735d1ad5-27dd-48fe-9d11-abc15c2f647b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.138018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-735d1ad5-27dd-48fe-9d11-abc15c2f647b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.138018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-735d1ad5-27dd-48fe-9d11-abc15c2f647b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.138018] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('735d1ad5-27dd-48fe-9d11-abc15c2f647b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.307409] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1269.307636] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.428454] env[61538]: INFO networking_nsxv3.common.synchronization [req-dc1db067-e6a0-40d8-badc-562eb33b58a6 req-a7c63c3e-7502-4ef8-9825-6da20499a476 tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1269.428938] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1269.429276] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.429454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.429500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.429686] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.429841] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.429942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.430015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.430166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.430252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.430347] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.635924] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.636213] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.641498] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 735d1ad5-27dd-48fe-9d11-abc15c2f647b with status ACTIVE [ 1269.641711] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.641866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.641904] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.642442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.642442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.642537] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.642639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.642700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.642851] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.642930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.643123] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.643219] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.643322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.646791] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.646897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.646998] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 735d1ad5-27dd-48fe-9d11-abc15c2f647b is going to be updated. [ 1269.672156] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.672467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.672467] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.672970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.672970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.672970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-735d1ad5-27dd-48fe-9d11-abc15c2f647b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.821111] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.821343] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.821618] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.822162] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.823151] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.823151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.823151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.823151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.823151] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.823522] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1269.823522] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1269.823522] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1269.823642] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1269.823766] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1269.823876] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1269.823922] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1269.862892] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1269.862892] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1269.863120] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1269.863396] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.863831] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-cf35a0bc-a18e-493b-b59c-794f2b962cd7 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.864126] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-cf35a0bc-a18e-493b-b59c-794f2b962cd7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.864333] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-cf35a0bc-a18e-493b-b59c-794f2b962cd7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.865179] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-cf35a0bc-a18e-493b-b59c-794f2b962cd7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.865179] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf35a0bc-a18e-493b-b59c-794f2b962cd7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.933058] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.933224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.933295] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.933536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.933610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.933821] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.933927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.933986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.934145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.934225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.934313] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1269.965376] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.965567] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.965632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.965798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.965976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.975190] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1270.368502] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.368774] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.369067] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.369347] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.369533] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.369705] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port cf35a0bc-a18e-493b-b59c-794f2b962cd7 not found, creating... [ 1270.370058] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.370250] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.370387] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.370692] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.370800] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.371182] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.371366] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.371491] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.371768] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.371945] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.374168] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: cf35a0bc-a18e-493b-b59c-794f2b962cd7 is going to be created. [ 1270.404771] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.404978] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.405129] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.405420] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.406041] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.406307] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-cf35a0bc-a18e-493b-b59c-794f2b962cd7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.724663] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: SUCCESS [ 1270.724973] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.725216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.725491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.725695] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.725893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.725893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.726048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.726133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.726236] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.228307] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.251493] env[61538]: INFO networking_nsxv3.common.synchronization [req-dc1db067-e6a0-40d8-badc-562eb33b58a6 req-9f2c4195-e824-4ef3-b388-18720a4100b0 service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1271.251587] env[61538]: INFO networking_nsxv3.common.synchronization [req-dc1db067-e6a0-40d8-badc-562eb33b58a6 req-9f2c4195-e824-4ef3-b388-18720a4100b0 service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1271.251853] env[61538]: INFO networking_nsxv3.common.synchronization [req-dc1db067-e6a0-40d8-badc-562eb33b58a6 req-9f2c4195-e824-4ef3-b388-18720a4100b0 service nova] Enqueued Resource ID: cf35a0bc-a18e-493b-b59c-794f2b962cd7 with Priority: HIGHEST for action port [ 1271.252651] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1271.252829] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1271.252903] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf35a0bc-a18e-493b-b59c-794f2b962cd7 with Priority: HIGHEST for action port [ 1271.253224] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.253383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.253454] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.253664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.253766] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.254686] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.254786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.254989] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf35a0bc-a18e-493b-b59c-794f2b962cd7 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.255155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf35a0bc-a18e-493b-b59c-794f2b962cd7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.255194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf35a0bc-a18e-493b-b59c-794f2b962cd7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.255387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf35a0bc-a18e-493b-b59c-794f2b962cd7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.255461] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf35a0bc-a18e-493b-b59c-794f2b962cd7',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.730655] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.757316] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.757473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.757679] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf35a0bc-a18e-493b-b59c-794f2b962cd7 with status ACTIVE [ 1271.757857] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.757961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.758038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.758252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.758347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.758506] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.758601] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.758692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.758813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.758898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.759087] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.759182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.759235] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.759378] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.759453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.759536] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf35a0bc-a18e-493b-b59c-794f2b962cd7 is going to be updated. [ 1271.781525] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.781682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.781726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.781945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.782099] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.782259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf35a0bc-a18e-493b-b59c-794f2b962cd7" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.985388] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1271.985578] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e deletion is rescheduled due to dependency. [ 1271.985697] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.985853] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.986091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.986331] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.986470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.986534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.986699] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.986783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.986981] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.232826] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.233012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.233116] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.233423] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.233529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.233637] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a445d437-8661-4393-ac08-d6abd23acc36 is going to be updated. [ 1272.298518] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.298518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.298518] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.298769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.298994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.325292] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: IN_PROGRESS for 2s [ 1272.489163] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.992571] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.497022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.497022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.497022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.497022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.497022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.497022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1273.546021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.546021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.546021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.546021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.546021] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.555254] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1274.344474] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: SUCCESS [ 1274.344775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.345143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.345390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.345652] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.345725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.345725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.346011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.346011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.346138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.346138] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.848600] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.351385] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a445d437-8661-4393-ac08-d6abd23acc36: rpc.has_security_group_logging(os_id): False [ 1275.372471] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.372471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.372471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.372471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.372471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.372471] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.372471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.372471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.372471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.372471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.372471] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a445d437-8661-4393-ac08-d6abd23acc36 is going to be updated. [ 1275.440902] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.440902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.440902] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.441412] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.441466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.463887] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: IN_PROGRESS for 2s [ 1275.566374] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1275.566374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.566374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.566374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.566374] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.566658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.566658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.566658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.566760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.566810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.566898] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.070349] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.070566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.070710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.071154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.071416] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.071416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.071524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.071779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.071918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.072168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.072475] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.072615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.072682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.072842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.072997] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.073121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.073180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.073318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.073399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.073480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.073570] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.254349] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.254531] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1276.371287] env[61538]: INFO networking_nsxv3.common.synchronization [req-ff0f141c-d708-482e-b9d5-10f1e0ea6542 req-11357389-82dd-447e-bd53-8b72363b3cc6 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1276.371789] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1276.372100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.372223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.372293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.372477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.372629] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.372774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.372774] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.372920] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.373023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.373256] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.576087] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 685f27e5-d19d-4490-b97e-a0015776b51e: rpc.has_security_group_logging(os_id): False [ 1276.596463] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.596744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.596744] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.597094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.597094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.597280] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.597389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.597462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.597622] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.597683] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.597877] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.597972] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.598039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.598180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.598255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.598461] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.598637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.598637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.598739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.598824] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.598947] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1276.673185] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.673408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.673408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.673606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.673760] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.689416] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1276.729330] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.729554] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.729675] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.729966] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.730246] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.730403] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.730525] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.730758] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.730911] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.731253] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1276.731396] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1276.731516] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1276.731629] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1276.731744] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1276.731854] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1276.732010] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1276.790888] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1276.791627] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.059 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1276.791627] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1276.791876] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.792412] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-a5c32d4d-c669-44cf-891b-60956afffddd taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.792635] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-a5c32d4d-c669-44cf-891b-60956afffddd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.792766] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-a5c32d4d-c669-44cf-891b-60956afffddd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.796020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-a5c32d4d-c669-44cf-891b-60956afffddd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.796020] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5c32d4d-c669-44cf-891b-60956afffddd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.879439] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.298226] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.298487] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.298624] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.299042] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.299219] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.299394] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port a5c32d4d-c669-44cf-891b-60956afffddd not found, creating... [ 1277.299783] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.300653] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.300834] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.301225] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.301499] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.301933] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.303062] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.303062] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.303062] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.303062] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.303238] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: a5c32d4d-c669-44cf-891b-60956afffddd is going to be created. [ 1277.326737] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.326987] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.327506] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.327612] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.327953] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.328252] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-a5c32d4d-c669-44cf-891b-60956afffddd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.382664] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.480676] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: SUCCESS [ 1277.480984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.886265] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.886416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.886469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.886685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.886777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.886885] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1277.937065] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.937300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.937300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.937474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.937645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.949869] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1278.587171] env[61538]: INFO networking_nsxv3.common.synchronization [None req-40fe7fec-8a64-4fb3-bcd9-168fb08a731b tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1278.587171] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1278.587171] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.587171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.587171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.587171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.587171] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.587171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.587171] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.588742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.588970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.589192] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.704769] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1278.704769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.906885] env[61538]: INFO networking_nsxv3.common.synchronization [req-ff0f141c-d708-482e-b9d5-10f1e0ea6542 req-62f17f4f-3b11-4903-916f-eeab386e4744 service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1278.908369] env[61538]: INFO networking_nsxv3.common.synchronization [req-ff0f141c-d708-482e-b9d5-10f1e0ea6542 req-62f17f4f-3b11-4903-916f-eeab386e4744 service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1278.908369] env[61538]: INFO networking_nsxv3.common.synchronization [req-ff0f141c-d708-482e-b9d5-10f1e0ea6542 req-62f17f4f-3b11-4903-916f-eeab386e4744 service nova] Enqueued Resource ID: a5c32d4d-c669-44cf-891b-60956afffddd with Priority: HIGHEST for action port [ 1278.908369] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1278.908369] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1278.908369] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c32d4d-c669-44cf-891b-60956afffddd with Priority: HIGHEST for action port [ 1278.908841] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.909033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.909225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.909617] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.909794] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.910853] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.911016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.911360] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5c32d4d-c669-44cf-891b-60956afffddd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.911681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5c32d4d-c669-44cf-891b-60956afffddd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.911784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5c32d4d-c669-44cf-891b-60956afffddd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.912112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5c32d4d-c669-44cf-891b-60956afffddd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.912248] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5c32d4d-c669-44cf-891b-60956afffddd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.094889] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.094889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.094889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.094889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.094889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.094889] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.094889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.094889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.094889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.094889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.094889] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1279.127938] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.127938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.127938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.127938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.135115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.144797] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1279.415218] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.415381] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.415597] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5c32d4d-c669-44cf-891b-60956afffddd with status ACTIVE [ 1279.415710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.415817] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.415883] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.416144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.416243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.416438] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.416546] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.416627] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.416822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.416906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.417183] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.417315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.417366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.417511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.417609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.417727] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5c32d4d-c669-44cf-891b-60956afffddd is going to be updated. [ 1279.447343] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.447343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.447343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.447343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.447343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.447343] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5c32d4d-c669-44cf-891b-60956afffddd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.960851] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1279.961216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.961216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.962091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.962091] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.962091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.962091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.962091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.962091] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.962384] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.468399] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.970592] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.154138] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1281.154334] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 deletion is rescheduled due to dependency. [ 1281.154453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.473321] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.473504] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.473577] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.473878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.473988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.474111] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1281.506147] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.506362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.506409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.506605] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.506846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.517612] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1283.530618] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1283.530997] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.531077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.531353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.531575] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.531709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.531786] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.531983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.532102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.532199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.532313] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.591178] env[61538]: INFO networking_nsxv3.common.synchronization [req-ec8a9ce0-992a-457e-b23e-fc269aa46f8a req-e898c20c-3826-4d37-82ba-51e0f97dfc2e tempest-ServerActionsTestJSON-1581508737 tempest-ServerActionsTestJSON-1581508737-project-member] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1283.591864] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGHEST for action security_group_members [ 1283.592363] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.592728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.592728] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.592815] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.592981] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.593188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.593188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.593328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.593424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.593517] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.035056] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.035237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.035300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.035511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.035679] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.035779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.035842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.036119] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.036215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.036307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.036461] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.036555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.036614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.036778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.036894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.036983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.037054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.037189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.037264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.037347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.037437] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.095841] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.096090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.096090] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.096370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.096506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.096598] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.096703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.096768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.096922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.097011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.097106] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be updated. [ 1284.124333] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.124679] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.124755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.124969] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.125131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.135789] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: IN_PROGRESS for 2s [ 1284.540359] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d26186c-7b4f-4430-a869-be9595e84fcc: rpc.has_security_group_logging(os_id): False [ 1284.562149] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.562399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.562399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.562657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.562772] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.563069] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.563189] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.563277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.563457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.563560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.563795] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.563909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.563989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.564152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.564243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.564500] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.564616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.564691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.564865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.564950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.565050] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1284.654515] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.654731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.654731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.654933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.655211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.678730] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1286.147588] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 in Status: SUCCESS [ 1286.147588] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 deletion is rescheduled due to dependency. [ 1286.147588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.695526] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1286.695764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.594047] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.594047] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.131561] env[61538]: INFO networking_nsxv3.common.synchronization [req-98979c6f-a7a3-4a95-aca3-37c7764e8a29 req-a22bad06-9e98-45c2-b88e-a30fa5cd0769 tempest-AttachVolumeShelveTestJSON-1204522908 tempest-AttachVolumeShelveTestJSON-1204522908-project-member] Enqueued Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_members [ 1290.132088] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6585f491-6358-4615-a571-0639903266ae with Priority: HIGHEST for action security_group_members [ 1290.132421] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-6585f491-6358-4615-a571-0639903266ae taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.132547] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.132615] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.132812] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.133144] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.133144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.133144] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.133409] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.133539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.133638] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6585f491-6358-4615-a571-0639903266ae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.636068] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.636341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.636341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.636555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.636629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.636815] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.636907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.636961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.637125] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.637205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.637293] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6585f491-6358-4615-a571-0639903266ae is going to be updated. [ 1290.667355] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.667530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.667616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.667878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.668080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.677705] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6585f491-6358-4615-a571-0639903266ae in Status: IN_PROGRESS for 2s [ 1292.047863] env[61538]: INFO networking_nsxv3.common.synchronization [req-0fb54966-11fb-42f4-819b-6b11c4f2844e req-2fa84194-5e02-4451-8fd3-58731eb1f6c8 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1292.048511] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1292.048825] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.048955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.053109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.053414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.053616] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.053734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.053792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.053944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.054054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.054160] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.306027] env[61538]: INFO networking_nsxv3.common.synchronization [None req-ddfc4a71-ea56-44ea-9fb9-ff2ef6d2a194 None None] Enqueued Resource ID: 62bc7145-25f9-452e-86ee-36b2c6b32c0b with Priority: HIGHEST for action port [ 1292.306027] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62bc7145-25f9-452e-86ee-36b2c6b32c0b with Priority: HIGHEST for action port [ 1292.306027] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-62bc7145-25f9-452e-86ee-36b2c6b32c0b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.306027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62bc7145-25f9-452e-86ee-36b2c6b32c0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.306027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62bc7145-25f9-452e-86ee-36b2c6b32c0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.306861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62bc7145-25f9-452e-86ee-36b2c6b32c0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.307511] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62bc7145-25f9-452e-86ee-36b2c6b32c0b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.418021] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.418021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.418021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.418021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.418021] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.418021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.418021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.418021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.418021] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.418593] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.418903] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.419196] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.419489] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.421849] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.421849] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.421849] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.441813] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.441813] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1292.441813] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.441813] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.441813] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-247b84fb-fa03-4324-adea-ff8f63fd6ec0 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.441813] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-247b84fb-fa03-4324-adea-ff8f63fd6ec0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.441813] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-247b84fb-fa03-4324-adea-ff8f63fd6ec0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.441813] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-247b84fb-fa03-4324-adea-ff8f63fd6ec0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.441813] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('247b84fb-fa03-4324-adea-ff8f63fd6ec0',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.556048] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.688311] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6585f491-6358-4615-a571-0639903266ae in Status: SUCCESS [ 1292.688514] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6585f491-6358-4615-a571-0639903266ae deletion is rescheduled due to dependency. [ 1292.688612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6585f491-6358-4615-a571-0639903266ae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.809834] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62bc7145-25f9-452e-86ee-36b2c6b32c0b [ 1292.810090] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.810956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.811183] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.811397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.811446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.811548] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62bc7145-25f9-452e-86ee-36b2c6b32c0b already deleted. [ 1292.811678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62bc7145-25f9-452e-86ee-36b2c6b32c0b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.949989] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.949989] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.949989] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.949989] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.949989] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.949989] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 247b84fb-fa03-4324-adea-ff8f63fd6ec0 not found, creating... [ 1292.949989] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.949989] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.949989] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.949989] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.950628] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.950628] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.950628] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.950628] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.950838] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.950962] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.951112] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 247b84fb-fa03-4324-adea-ff8f63fd6ec0 is going to be created. [ 1292.972905] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.973204] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.973345] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.973641] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.973878] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.974138] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-247b84fb-fa03-4324-adea-ff8f63fd6ec0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.060031] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.561913] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.562158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.562158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.562300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.562410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.562508] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1293.607099] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.607320] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.607320] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.607529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.607684] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.631610] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1294.277886] env[61538]: INFO networking_nsxv3.common.synchronization [req-0fb54966-11fb-42f4-819b-6b11c4f2844e req-2dd5dff6-500b-467a-b2ac-90961004143f service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1294.278304] env[61538]: INFO networking_nsxv3.common.synchronization [req-0fb54966-11fb-42f4-819b-6b11c4f2844e req-2dd5dff6-500b-467a-b2ac-90961004143f service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1294.278304] env[61538]: INFO networking_nsxv3.common.synchronization [req-0fb54966-11fb-42f4-819b-6b11c4f2844e req-2dd5dff6-500b-467a-b2ac-90961004143f service nova] Enqueued Resource ID: 247b84fb-fa03-4324-adea-ff8f63fd6ec0 with Priority: HIGHEST for action port [ 1294.278822] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1294.278986] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1294.279557] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247b84fb-fa03-4324-adea-ff8f63fd6ec0 with Priority: HIGHEST for action port [ 1294.279888] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.280034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.280115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.280318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.280421] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.281341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.281476] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.281834] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-247b84fb-fa03-4324-adea-ff8f63fd6ec0 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.281935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-247b84fb-fa03-4324-adea-ff8f63fd6ec0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.281982] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-247b84fb-fa03-4324-adea-ff8f63fd6ec0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.282217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-247b84fb-fa03-4324-adea-ff8f63fd6ec0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.282300] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('247b84fb-fa03-4324-adea-ff8f63fd6ec0',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.331346] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.331636] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.331862] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.331978] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.333125] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.333404] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.333634] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.333763] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.334024] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.334494] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.334681] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.334821] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.335054] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.335712] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.335712] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.335712] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.359271] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.359639] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1294.359639] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.359844] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.360165] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-67104b0f-71e5-40be-965b-8376a6c120f8 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.360360] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.360480] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.361459] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.361459] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67104b0f-71e5-40be-965b-8376a6c120f8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.585741] env[61538]: INFO networking_nsxv3.common.synchronization [req-084910e2-6e4f-4f61-9687-89d060068b39 req-441bcea0-171d-4213-9a21-942dfaf5e3ed tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 1294.587050] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 1294.587050] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.587050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.587050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.587366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.587366] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.587480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.587537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.587738] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.587827] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.587922] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.788022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.788022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.788022] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 247b84fb-fa03-4324-adea-ff8f63fd6ec0 with status ACTIVE [ 1294.788022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.788022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.788022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.788022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.788022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.788022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.788022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.788022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.788022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.788022] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.788022] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.788716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.788716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.788716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.788716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.788716] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 247b84fb-fa03-4324-adea-ff8f63fd6ec0 is going to be updated. [ 1294.811142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.811734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.812305] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.812693] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.813260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.813260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-247b84fb-fa03-4324-adea-ff8f63fd6ec0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.854202] env[61538]: INFO networking_nsxv3.common.synchronization [None req-b3788c3a-9ef7-4b2b-8167-c0e5a01a26e6 None None] Enqueued Resource ID: 5ec82d94-0d90-4012-84b3-7310042587c1 with Priority: HIGHEST for action port [ 1294.854202] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec82d94-0d90-4012-84b3-7310042587c1 with Priority: HIGHEST for action port [ 1294.855721] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ec82d94-0d90-4012-84b3-7310042587c1 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.856273] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ec82d94-0d90-4012-84b3-7310042587c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.857100] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ec82d94-0d90-4012-84b3-7310042587c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.859187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ec82d94-0d90-4012-84b3-7310042587c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.859187] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ec82d94-0d90-4012-84b3-7310042587c1',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.868026] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.868026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.868026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.868026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.868026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.868026] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 67104b0f-71e5-40be-965b-8376a6c120f8 not found, creating... [ 1294.868026] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.868026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.868026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.868026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.868026] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.868574] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.868574] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.868574] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.869025] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.869243] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.869374] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 67104b0f-71e5-40be-965b-8376a6c120f8 is going to be created. [ 1294.915100] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.915288] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.915600] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.915690] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.915931] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.916111] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.944774] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.945039] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.945117] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.945440] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.945633] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.945867] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.945906] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.946451] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.946451] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.946556] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.946589] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.946699] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.946809] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.946924] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.947045] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.947193] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.974364] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.974662] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1294.974926] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.975245] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-138" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.975874] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-9586e46e-23b8-40a2-9703-712bf31c9e96 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.978344] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-9586e46e-23b8-40a2-9703-712bf31c9e96" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.978344] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-9586e46e-23b8-40a2-9703-712bf31c9e96" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.978344] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-9586e46e-23b8-40a2-9703-712bf31c9e96" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.978344] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9586e46e-23b8-40a2-9703-712bf31c9e96',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.090142] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.359917] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ec82d94-0d90-4012-84b3-7310042587c1 [ 1295.360189] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.360277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.360335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.360576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.360660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.360752] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ec82d94-0d90-4012-84b3-7310042587c1 already deleted. [ 1295.360828] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ec82d94-0d90-4012-84b3-7310042587c1" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.449426] env[61538]: INFO networking_nsxv3.common.synchronization [None req-0450fdb8-fc03-45b6-8f1d-e6aaaaa8e8c9 None None] Enqueued Resource ID: 33337541-41d6-413f-b225-325527cc586c with Priority: HIGHEST for action port [ 1295.449938] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33337541-41d6-413f-b225-325527cc586c with Priority: HIGHEST for action port [ 1295.450580] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-33337541-41d6-413f-b225-325527cc586c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.450710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33337541-41d6-413f-b225-325527cc586c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.450778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33337541-41d6-413f-b225-325527cc586c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.451050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33337541-41d6-413f-b225-325527cc586c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.451135] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33337541-41d6-413f-b225-325527cc586c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.482976] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.485018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.485018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.485018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.485018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.485018] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 9586e46e-23b8-40a2-9703-712bf31c9e96 not found, creating... [ 1295.485018] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.485018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.485018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.485018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.485018] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.485725] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.485725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.485725] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.486156] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.486329] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.486476] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 9586e46e-23b8-40a2-9703-712bf31c9e96 is going to be created. [ 1295.509072] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.509343] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.509487] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.509772] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.510013] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.510248] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-9586e46e-23b8-40a2-9703-712bf31c9e96" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.593723] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.622302] env[61538]: INFO networking_nsxv3.common.synchronization [req-731d1c96-6b04-4a2e-9e7b-7994f12deec9 req-63604469-6d7b-472a-ab95-7d8e94218165 tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1295.623646] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1295.624085] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.624278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.624353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.624569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.624732] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.624831] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.624893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.625052] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.625139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.625239] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.648752] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1295.648991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.649202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.649434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.649659] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.649776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.649819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.649942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.650039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.650141] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.953435] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33337541-41d6-413f-b225-325527cc586c [ 1295.953713] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.953897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.953936] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.954153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.954263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.954340] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33337541-41d6-413f-b225-325527cc586c already deleted. [ 1295.954426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33337541-41d6-413f-b225-325527cc586c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.960265] env[61538]: INFO networking_nsxv3.common.synchronization [req-7921aad3-2e8f-4bc4-935c-267e7bc26549 req-dc26ac9d-fbd7-4952-9567-d049b31f4081 service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1295.960447] env[61538]: INFO networking_nsxv3.common.synchronization [req-7921aad3-2e8f-4bc4-935c-267e7bc26549 req-dc26ac9d-fbd7-4952-9567-d049b31f4081 service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1295.960593] env[61538]: INFO networking_nsxv3.common.synchronization [req-7921aad3-2e8f-4bc4-935c-267e7bc26549 req-dc26ac9d-fbd7-4952-9567-d049b31f4081 service nova] Enqueued Resource ID: 67104b0f-71e5-40be-965b-8376a6c120f8 with Priority: HIGHEST for action port [ 1295.960832] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1295.960963] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1295.961071] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67104b0f-71e5-40be-965b-8376a6c120f8 with Priority: HIGHEST for action port [ 1295.961683] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.961806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.961872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.962161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.962266] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.964045] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.964355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.964460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.964881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.965460] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.965564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.965667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.965841] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.965938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.966047] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.966967] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-67104b0f-71e5-40be-965b-8376a6c120f8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.967559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.967800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.968047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.968137] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67104b0f-71e5-40be-965b-8376a6c120f8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.095556] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.095731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.095792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.096015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.096122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.096224] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c is going to be updated. [ 1296.127994] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.128268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.128268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.128452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.128548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.128740] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.128941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.128941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.129077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.129138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.129281] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1296.131084] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.131200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.131200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.131394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.131534] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.148919] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: IN_PROGRESS for 2s [ 1296.153029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.163512] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.163723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.163723] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.164373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.164709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.175379] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1296.339725] env[61538]: INFO networking_nsxv3.common.synchronization [req-084910e2-6e4f-4f61-9687-89d060068b39 req-91cad55b-0894-4e98-8a0a-a9fb05b2ce30 service nova] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_rules [ 1296.340286] env[61538]: INFO networking_nsxv3.common.synchronization [req-084910e2-6e4f-4f61-9687-89d060068b39 req-91cad55b-0894-4e98-8a0a-a9fb05b2ce30 service nova] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 1296.340286] env[61538]: INFO networking_nsxv3.common.synchronization [req-084910e2-6e4f-4f61-9687-89d060068b39 req-91cad55b-0894-4e98-8a0a-a9fb05b2ce30 service nova] Enqueued Resource ID: 9586e46e-23b8-40a2-9703-712bf31c9e96 with Priority: HIGHEST for action port [ 1296.340707] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_rules [ 1296.341935] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 1296.341935] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9586e46e-23b8-40a2-9703-712bf31c9e96 with Priority: HIGHEST for action port [ 1296.342242] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.342374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.342465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.342740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.342793] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.343864] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.343864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.344037] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-9586e46e-23b8-40a2-9703-712bf31c9e96 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.344155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9586e46e-23b8-40a2-9703-712bf31c9e96" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.344218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9586e46e-23b8-40a2-9703-712bf31c9e96" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.344359] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9586e46e-23b8-40a2-9703-712bf31c9e96" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.348185] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9586e46e-23b8-40a2-9703-712bf31c9e96',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.471291] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.471291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.472774] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.474356] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67104b0f-71e5-40be-965b-8376a6c120f8 with status ACTIVE [ 1296.474356] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.474356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.474356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.474356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.474356] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.474618] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.474618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.474618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.474892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.474892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.475151] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.475151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.475151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.475403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.475403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.475639] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67104b0f-71e5-40be-965b-8376a6c120f8 is going to be updated. [ 1296.504925] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.505015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.505131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.505308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.505445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.505607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.656148] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.850174] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.850318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.850507] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9586e46e-23b8-40a2-9703-712bf31c9e96 with status ACTIVE [ 1296.850676] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.850777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.850840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.851068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.851156] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.851352] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.851452] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.851512] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.851737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.851737] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.854153] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.854153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.854153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.854153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.854153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.854153] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9586e46e-23b8-40a2-9703-712bf31c9e96 is going to be updated. [ 1296.914103] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.914103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.914103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.914103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.914103] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.914873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9586e46e-23b8-40a2-9703-712bf31c9e96" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.977664] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.162296] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.162296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.162296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.162296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.162296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.162296] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1297.193542] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.193731] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.193809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.194035] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.194193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.205650] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1297.480979] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.481350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.481350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.481463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.481463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.481556] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1297.516441] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.516441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.516441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.516441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.516441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.524991] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1297.782465] env[61538]: INFO networking_nsxv3.common.synchronization [None req-62898752-93d0-4d1a-ae83-6e0e4bfac200 None None] Enqueued Resource ID: df6fb229-7579-4fe3-bc24-7fde5593afbb with Priority: HIGHEST for action port [ 1297.783089] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df6fb229-7579-4fe3-bc24-7fde5593afbb with Priority: HIGHEST for action port [ 1297.783416] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-df6fb229-7579-4fe3-bc24-7fde5593afbb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.784225] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df6fb229-7579-4fe3-bc24-7fde5593afbb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.784327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df6fb229-7579-4fe3-bc24-7fde5593afbb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.784610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df6fb229-7579-4fe3-bc24-7fde5593afbb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.784700] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df6fb229-7579-4fe3-bc24-7fde5593afbb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.160996] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: SUCCESS [ 1298.161347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.161681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.162198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.162345] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.162464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.162642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.162861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.163048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.163273] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.187110] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1298.187110] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e deletion is rescheduled due to dependency. [ 1298.187110] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.286888] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df6fb229-7579-4fe3-bc24-7fde5593afbb [ 1298.287106] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.287976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.287976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.287976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.287976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.287976] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df6fb229-7579-4fe3-bc24-7fde5593afbb already deleted. [ 1298.287976] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df6fb229-7579-4fe3-bc24-7fde5593afbb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.665613] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.169295] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.217665] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1299.217807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.218073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.218239] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.218406] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.218531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.218594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.218770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.218946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.218946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.219056] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.536449] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1299.536702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.536908] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.537163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.537377] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.537522] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.537594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.538190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.538190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.538190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.538190] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.673133] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.673133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.673133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.673133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.673133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.673808] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c is going to be updated. [ 1299.704919] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.705135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.705190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.705477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.705732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.716029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: IN_PROGRESS for 2s [ 1299.721548] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.721759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.721971] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.722195] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.722413] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.722942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.722942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.722942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.722942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.722942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.723238] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.723238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.723335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.723575] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.723675] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.723818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.723927] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.724146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.724268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.724377] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.724478] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.040411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.040624] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.040691] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.040892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.041077] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.041181] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.041248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.041488] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.041587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.041682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.041892] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.041990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.042064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.042211] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.042443] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.042535] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.042583] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.042721] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.042800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.042930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.043261] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.227221] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d26186c-7b4f-4430-a869-be9595e84fcc: rpc.has_security_group_logging(os_id): False [ 1300.249422] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.249695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.249814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.250115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.250279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.250634] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.250826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.250945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.251159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.251352] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.251696] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.251947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.252073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.252338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.252474] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.252755] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.252923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.253036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.253237] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.253363] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.253497] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1300.329334] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.329562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.329562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.329836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.329933] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.349639] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1300.546467] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1636da8b-a16b-42d3-874d-5d8471397fd6: rpc.has_security_group_logging(os_id): False [ 1300.573253] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.573458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.573458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.573701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.573806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.574050] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.574156] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.574221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.574395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.574497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.574683] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.574776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.574837] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.574979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.575064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.575245] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.575338] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.575400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.575536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.575613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.575796] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1300.678581] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.678990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.678990] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.679398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.679568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.701536] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1301.727096] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: SUCCESS [ 1301.727503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.727503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.727781] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.728045] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.728199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.728406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.728541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.728595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.728713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.728833] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.231052] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.370872] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1302.371124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.720542] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1302.720542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.733519] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for febfb45e-9229-49aa-8dfc-5f90dbca1a4c: rpc.has_security_group_logging(os_id): False [ 1302.763166] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.763433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.763433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.763720] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.763819] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.764100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.764205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.764266] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.764470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.764580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.764649] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c is going to be updated. [ 1302.784219] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1302.784418] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1302.875727] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.876128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.876128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.876383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.876383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.902376] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: IN_PROGRESS for 2s [ 1302.923483] env[61538]: INFO networking_nsxv3.common.synchronization [req-82a721e8-2224-47a6-8a2d-70a60b918c32 req-23065d05-35a7-4bde-99ed-6a24e3306bcd tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1302.924312] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1302.924806] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.924989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.925104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.925403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.926419] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.926952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.926952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.927092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.927129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.927274] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.272778] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.272994] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.273136] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.273424] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.273716] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.273870] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.273995] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.274229] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.274382] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.274604] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1303.274724] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1303.274838] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1303.274952] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1303.275085] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1303.275197] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1303.275334] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1303.298951] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1303.299145] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1303.299287] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1303.299480] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.299831] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.300015] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.300145] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.300616] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.300768] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ec8bc8-486b-4eea-8d00-5b81fe9f1380',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.429481] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.429733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.429733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.429945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.430064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.430321] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.430472] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.430528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.430671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.430749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.430838] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1303.469045] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.469045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.469045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.469045] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.469514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.480254] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1303.803403] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.804290] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.804424] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.806477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.806477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.806477] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 10ec8bc8-486b-4eea-8d00-5b81fe9f1380 not found, creating... [ 1303.806477] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.806477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.806477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.806477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.806477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.806477] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.807064] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.807064] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.807064] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.807372] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.807470] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 10ec8bc8-486b-4eea-8d00-5b81fe9f1380 is going to be created. [ 1303.835091] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.835091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.835091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.835091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.835091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.835091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.625073] env[61538]: INFO networking_nsxv3.common.synchronization [req-82a721e8-2224-47a6-8a2d-70a60b918c32 req-df05b0ce-9a4c-4c42-85a3-093081c661a0 service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1304.625266] env[61538]: INFO networking_nsxv3.common.synchronization [req-82a721e8-2224-47a6-8a2d-70a60b918c32 req-df05b0ce-9a4c-4c42-85a3-093081c661a0 service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1304.625416] env[61538]: INFO networking_nsxv3.common.synchronization [req-82a721e8-2224-47a6-8a2d-70a60b918c32 req-df05b0ce-9a4c-4c42-85a3-093081c661a0 service nova] Enqueued Resource ID: 10ec8bc8-486b-4eea-8d00-5b81fe9f1380 with Priority: HIGHEST for action port [ 1304.625936] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1304.626091] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1304.626191] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ec8bc8-486b-4eea-8d00-5b81fe9f1380 with Priority: HIGHEST for action port [ 1304.626464] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.626595] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.626682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.627548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.627548] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.628015] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.628129] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.628500] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.628500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.628500] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.628681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.628716] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ec8bc8-486b-4eea-8d00-5b81fe9f1380',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.917904] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: SUCCESS [ 1304.918280] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.131300] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.131300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.131531] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10ec8bc8-486b-4eea-8d00-5b81fe9f1380 with status ACTIVE [ 1305.131781] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.132051] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.132176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.132366] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.132479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.132700] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.132809] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.132881] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.133085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.133221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.133427] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.133551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.133623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.133780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.133893] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.133984] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10ec8bc8-486b-4eea-8d00-5b81fe9f1380 is going to be updated. [ 1305.159222] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.159514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.159599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.159820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.159962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.160147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ec8bc8-486b-4eea-8d00-5b81fe9f1380" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.494205] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1305.494437] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e deletion is rescheduled due to dependency. [ 1305.494614] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.494886] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.495323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.495580] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.495742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.495940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.496054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.496153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.496311] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.998151] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.503640] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.009360] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.009764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.009764] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.010253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.010413] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.010802] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1307.045991] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.046193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.046274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.046551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.046704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.057379] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1307.764462] env[61538]: INFO networking_nsxv3.common.synchronization [req-b5ea4734-63b2-4fb9-b15c-30d07f80ce3b req-cb8a1935-8fd9-4c29-b122-7394d01fb390 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1307.765021] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1307.765349] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.765470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.765544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.765803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.765973] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.766089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.766155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.766291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.766369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.766464] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.102806] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.103182] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.103496] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.103870] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.104230] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.104445] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.104605] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.105173] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.105389] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.105667] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1308.105811] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1308.105989] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1308.106171] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1308.106533] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1308.106699] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1308.106851] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1308.128428] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1308.128629] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1308.128831] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1308.129087] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-249" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.129447] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-ff62e994-2e58-433b-884f-5b4fa7639d6b taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.129651] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.129806] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.130130] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.130288] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff62e994-2e58-433b-884f-5b4fa7639d6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.269705] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.643859] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.644032] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.644174] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.644477] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.644637] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.644950] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.645135] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.645316] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.645495] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.645641] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.645943] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.646187] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.646246] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.646579] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.646769] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.646929] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: ff62e994-2e58-433b-884f-5b4fa7639d6b is going to be updated. [ 1308.681054] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.681314] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.681497] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.681809] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.682146] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.682324] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.772052] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.068596] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1309.068845] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.069070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.069304] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.069531] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.069668] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.069741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.069860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.069938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.070965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.071171] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.274824] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.275194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.275194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.275311] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.276162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.276283] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1309.312018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.312216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.312264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.312455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.312712] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.324483] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1309.573920] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.574230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.574230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.574470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.574659] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.574799] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.574894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.575143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.575275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.575418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.575629] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.575735] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.575794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.575940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.576096] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.576182] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.576238] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.576371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.576558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.576558] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.576682] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.078993] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 685f27e5-d19d-4490-b97e-a0015776b51e: rpc.has_security_group_logging(os_id): False [ 1310.099132] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.099294] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.099509] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.099674] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.099822] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.100080] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.100212] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.100301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.100536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.100813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.100813] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.101109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.101109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.101175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.101293] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.101588] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.101730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.101730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.101899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.102033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.102140] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1310.105993] env[61538]: INFO networking_nsxv3.common.synchronization [req-62628359-d9e3-4f4c-83a9-bbb5cac8fa4d req-286244fe-d01b-44b4-ab5e-73bb06250031 service nova] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 1310.105993] env[61538]: INFO networking_nsxv3.common.synchronization [req-62628359-d9e3-4f4c-83a9-bbb5cac8fa4d req-286244fe-d01b-44b4-ab5e-73bb06250031 service nova] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1310.106136] env[61538]: INFO networking_nsxv3.common.synchronization [req-62628359-d9e3-4f4c-83a9-bbb5cac8fa4d req-286244fe-d01b-44b4-ab5e-73bb06250031 service nova] Enqueued Resource ID: ff62e994-2e58-433b-884f-5b4fa7639d6b with Priority: HIGHEST for action port [ 1310.106848] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_rules [ 1310.107049] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1310.107192] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff62e994-2e58-433b-884f-5b4fa7639d6b with Priority: HIGHEST for action port [ 1310.107489] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.107640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.107741] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.108010] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.108285] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.109774] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.109912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.109993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.110431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.110431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.110594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.110717] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.110801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.110924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.111066] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.113637] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff62e994-2e58-433b-884f-5b4fa7639d6b taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.113820] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.113892] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.114033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.114324] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff62e994-2e58-433b-884f-5b4fa7639d6b',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.170521] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.170682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.170912] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.171162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.171321] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.188841] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1310.546133] env[61538]: INFO networking_nsxv3.common.synchronization [req-870067e3-70d0-493a-b157-7500b3a45e8b req-6dd316ed-0175-4cd1-8890-17c8fa7ea090 tempest-ServersNegativeTestMultiTenantJSON-147642954 tempest-ServersNegativeTestMultiTenantJSON-147642954-project-member] Enqueued Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGHEST for action security_group_members [ 1310.546133] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGHEST for action security_group_members [ 1310.546133] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaf7f2ed-f7df-4976-891c-e301c5c1016e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.546133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.546133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.546133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.546133] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.546133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.547033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.548242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.548242] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.548462] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaf7f2ed-f7df-4976-891c-e301c5c1016e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.614085] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.616712] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.616839] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.616975] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff62e994-2e58-433b-884f-5b4fa7639d6b with status ACTIVE [ 1310.617145] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.617240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.617298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.617502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.617586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.617748] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.617834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.617891] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.618038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.618111] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.618319] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.618444] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.618493] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.618606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.618675] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.618803] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff62e994-2e58-433b-884f-5b4fa7639d6b is going to be updated. [ 1310.644893] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.645104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.645104] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.645276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.645414] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.645578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff62e994-2e58-433b-884f-5b4fa7639d6b" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.054284] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.054459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.054515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.054750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.054846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.055063] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.055168] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.055231] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.055380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.055456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.055546] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e already deleted. [ 1311.055625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.115993] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.302953] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.303848] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-835" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.304155] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-835" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.304648] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-835" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.305086] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.305403] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.305751] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.306202] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.306518] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.306917] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1311.307181] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1311.307450] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1311.307707] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1311.308143] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1311.308430] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1311.308720] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1311.333025] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1311.333244] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1311.333395] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1311.333607] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-835" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.333970] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-98656068-e5a8-462f-bf47-905ed2b92aae taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.334277] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-98656068-e5a8-462f-bf47-905ed2b92aae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.334425] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-98656068-e5a8-462f-bf47-905ed2b92aae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.335565] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-98656068-e5a8-462f-bf47-905ed2b92aae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.335943] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98656068-e5a8-462f-bf47-905ed2b92aae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.338680] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1311.338978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.618716] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.619071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.619071] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.619346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.619527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.619610] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1311.651869] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.652025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.652097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.652308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.652498] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.662471] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1311.841382] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.841814] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.842040] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.842466] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.842717] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.842969] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 98656068-e5a8-462f-bf47-905ed2b92aae not found, creating... [ 1311.843418] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.843693] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.843907] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.844525] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.844897] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.845574] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.845977] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.846313] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.846775] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.847238] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.847612] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 98656068-e5a8-462f-bf47-905ed2b92aae is going to be created. [ 1311.872447] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.872754] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.872873] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.873167] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.873428] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.873700] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-98656068-e5a8-462f-bf47-905ed2b92aae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.206221] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1312.206566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.811368] env[61538]: INFO networking_nsxv3.common.synchronization [req-870067e3-70d0-493a-b157-7500b3a45e8b req-e13d487b-31bd-4fe0-a1a6-b31727c7defd service nova] Enqueued Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGHEST for action security_group_rules [ 1312.811727] env[61538]: INFO networking_nsxv3.common.synchronization [req-870067e3-70d0-493a-b157-7500b3a45e8b req-e13d487b-31bd-4fe0-a1a6-b31727c7defd service nova] Enqueued Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGHEST for action security_group_members [ 1312.811727] env[61538]: INFO networking_nsxv3.common.synchronization [req-870067e3-70d0-493a-b157-7500b3a45e8b req-e13d487b-31bd-4fe0-a1a6-b31727c7defd service nova] Enqueued Resource ID: 98656068-e5a8-462f-bf47-905ed2b92aae with Priority: HIGHEST for action port [ 1312.811972] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGHEST for action security_group_rules [ 1312.812124] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGHEST for action security_group_members [ 1312.812222] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98656068-e5a8-462f-bf47-905ed2b92aae with Priority: HIGHEST for action port [ 1312.812811] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.812931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.812999] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.813568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.813690] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaf7f2ed-f7df-4976-891c-e301c5c1016e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.814552] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaf7f2ed-f7df-4976-891c-e301c5c1016e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.814665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.814733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.814900] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.815063] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.815161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.815406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.815592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.815800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.815800] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaf7f2ed-f7df-4976-891c-e301c5c1016e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.822727] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-98656068-e5a8-462f-bf47-905ed2b92aae taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.822727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98656068-e5a8-462f-bf47-905ed2b92aae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.822727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98656068-e5a8-462f-bf47-905ed2b92aae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.822727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98656068-e5a8-462f-bf47-905ed2b92aae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.822727] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98656068-e5a8-462f-bf47-905ed2b92aae',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.919755] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1312.919891] env[61538]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-025e8300-3f82-44ad-9aec-4edbc3b245ef None None] NSXv3 Agent Agent loop - iteration:3 started [ 1313.254838] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.255090] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.255242] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.255604] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.255928] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.256177] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.256369] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.256710] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.256912] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.257228] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.257441] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1313.257600] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1313.257805] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1313.258130] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.258211] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1313.258399] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1313.279131] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1313.279356] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1313.279591] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1313.279911] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-766" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.280393] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-67104b0f-71e5-40be-965b-8376a6c120f8 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.280678] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.280930] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.281376] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.281722] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67104b0f-71e5-40be-965b-8376a6c120f8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.323943] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98656068-e5a8-462f-bf47-905ed2b92aae with status ACTIVE [ 1313.324327] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.324588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.324724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.325085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.325263] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.325605] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.326296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.326296] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.326545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.326701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.326990] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.327208] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.327394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.327681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.327865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.328052] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98656068-e5a8-462f-bf47-905ed2b92aae is going to be updated. [ 1313.329804] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaf7f2ed-f7df-4976-891c-e301c5c1016e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.332406] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaf7f2ed-f7df-4976-891c-e301c5c1016e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.332406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.354058] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.354188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.354262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.354496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.354637] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.354814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98656068-e5a8-462f-bf47-905ed2b92aae" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.674336] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1313.674584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.674767] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.675229] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.675450] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.675562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.675562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.675698] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.675782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.675866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.675958] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.784680] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.784949] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.785115] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.785479] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.785625] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.785966] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.786172] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.786312] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.786577] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.786882] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.787196] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.787365] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.787491] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.787732] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.787920] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.788080] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 67104b0f-71e5-40be-965b-8376a6c120f8 is going to be updated. [ 1313.809503] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.809804] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.809915] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.810196] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.810401] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.810678] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.833029] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaf7f2ed-f7df-4976-891c-e301c5c1016e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.178147] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.335374] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.335599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.335599] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.335813] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.335913] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.336029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e is going to be created. [ 1314.361692] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.361692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.361692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.361692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.361692] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.375317] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e in Status: UNINITIALIZED for 2s [ 1314.609044] env[61538]: INFO networking_nsxv3.common.synchronization [req-7ebab330-589d-4e13-95e7-9ff0a8715059 req-a7870165-2ed5-4bb5-9038-b75a50d0c5bc service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1314.609348] env[61538]: INFO networking_nsxv3.common.synchronization [req-7ebab330-589d-4e13-95e7-9ff0a8715059 req-a7870165-2ed5-4bb5-9038-b75a50d0c5bc service nova] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1314.609542] env[61538]: INFO networking_nsxv3.common.synchronization [req-7ebab330-589d-4e13-95e7-9ff0a8715059 req-a7870165-2ed5-4bb5-9038-b75a50d0c5bc service nova] Enqueued Resource ID: 67104b0f-71e5-40be-965b-8376a6c120f8 with Priority: HIGHEST for action port [ 1314.609824] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_rules [ 1314.610033] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1314.610130] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67104b0f-71e5-40be-965b-8376a6c120f8 with Priority: HIGHEST for action port [ 1314.610797] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.611043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.611043] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.611846] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.612127] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.613545] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.613709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.614798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.614798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.614798] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.614798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.614798] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.615063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.615063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.615167] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.616217] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-67104b0f-71e5-40be-965b-8376a6c120f8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.616403] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.616508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.618255] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.618255] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67104b0f-71e5-40be-965b-8376a6c120f8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.680134] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e51a7e95-5364-42cc-944f-ced83c3e81b9: rpc.has_security_group_logging(os_id): False [ 1314.700876] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.700876] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.700876] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.701278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.701278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.701396] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.701396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.701576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.701733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.701843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.701961] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1314.772997] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.773174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.773245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.773471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.773634] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.789307] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1315.119380] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.120566] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.121739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.121739] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67104b0f-71e5-40be-965b-8376a6c120f8 with status ACTIVE [ 1315.121739] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.121739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.121739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.121739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.121739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.121739] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.121739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.121739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.122120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.122120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.122289] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.122289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.122289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.122520] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.122581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.122648] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67104b0f-71e5-40be-965b-8376a6c120f8 is going to be updated. [ 1315.252220] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.252401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.252468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.252729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.252866] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.253141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67104b0f-71e5-40be-965b-8376a6c120f8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.590516] env[61538]: INFO networking_nsxv3.common.synchronization [req-6a12d53c-ccb2-442d-8467-b86c3a21416f req-ee1d454a-982e-4469-ae36-41f572db495b tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1315.591121] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1315.591448] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.591598] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.591664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.591868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.592125] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.592243] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.592306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.592449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.592549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.592658] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.625345] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.096876] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.129139] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.129139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.129139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.129139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.129642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.129642] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1316.168036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.168036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.168036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.168036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.168036] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.181390] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1316.388549] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e in Status: SUCCESS [ 1316.388549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.388549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.388549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.388549] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.388549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.388549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.388549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.388549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.388549] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.388549] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaf7f2ed-f7df-4976-891c-e301c5c1016e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.598437] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.804605] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1316.804857] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.892167] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaf7f2ed-f7df-4976-891c-e301c5c1016e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.892428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.892428] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.892657] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.892841] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.892981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.893064] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.893188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.893279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.893384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.893526] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaf7f2ed-f7df-4976-891c-e301c5c1016e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.893611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.893665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.893836] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.893958] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.894055] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.894112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.894248] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.894323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.894406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.894497] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaf7f2ed-f7df-4976-891c-e301c5c1016e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.101079] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.101390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.101524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.101898] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.102050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.102229] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1317.138167] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.138553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.138553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.138645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.138756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.150406] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1317.397070] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaf7f2ed-f7df-4976-891c-e301c5c1016e: rpc.has_security_group_logging(os_id): False [ 1317.416436] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.416716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.416716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.416867] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.416962] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.417180] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.417285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.417375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.417555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.417633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.417863] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.417974] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.418053] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.418215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.418272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.418437] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.418521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.418594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.418715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.418794] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.418872] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e is going to be created. [ 1317.483220] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.483392] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.483439] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.483724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.483968] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.495914] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e in Status: IN_PROGRESS for 2s [ 1318.195070] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1318.195471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.195471] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.195579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.195791] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.195944] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.196024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.196202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.196289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.196375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.196478] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.699761] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.699761] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.700102] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.701073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.701073] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.701073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.701073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.701073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.701073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.701073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.701462] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.701462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.701462] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.701658] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.701834] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.701955] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.702049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.702395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.702395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.702527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.702527] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.164527] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1319.164527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.205030] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1636da8b-a16b-42d3-874d-5d8471397fd6: rpc.has_security_group_logging(os_id): False [ 1319.226931] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.227093] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.227276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.227424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.227592] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.227919] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.227919] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.228073] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.228214] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.228353] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.228536] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.228643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.228748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.228871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.228941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.229170] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.229308] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.229449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.229588] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.229638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.229735] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be updated. [ 1319.308194] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.308371] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.308513] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.308719] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.308889] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.327801] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: IN_PROGRESS for 2s [ 1319.512984] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e in Status: SUCCESS [ 1319.513259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.592543] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.592943] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1321.347751] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 in Status: SUCCESS [ 1321.348063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.485202] env[61538]: INFO networking_nsxv3.common.synchronization [req-30e08ea4-42df-46eb-bb34-fe8013f8f135 req-ea2320df-82df-43a6-80c2-104a3d8f563a tempest-ServersNegativeTestMultiTenantJSON-147642954 tempest-ServersNegativeTestMultiTenantJSON-147642954-project-member] Enqueued Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGHEST for action security_group_members [ 1325.485202] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGHEST for action security_group_members [ 1325.485940] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaf7f2ed-f7df-4976-891c-e301c5c1016e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.486274] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.486480] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.488621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.488621] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.488621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.488621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.488621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.488621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.488621] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaf7f2ed-f7df-4976-891c-e301c5c1016e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.989869] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.990160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.990160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.990289] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.990339] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.990544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.990659] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.990716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.990860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.990950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.991029] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e is going to be updated. [ 1326.020740] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.020740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.020740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.020740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.020740] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.031064] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e in Status: IN_PROGRESS for 2s [ 1326.681098] env[61538]: INFO networking_nsxv3.common.synchronization [req-5cac0357-4d81-448f-9d09-ffcbe0f0834e req-4b375b0f-1916-481b-944a-af2ac30dcb5c tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1326.681659] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1326.681984] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.682125] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.682199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.682609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.682711] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.682811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.682877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.683039] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.683128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.683226] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.185107] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.202439] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.203040] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.203040] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.203249] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.203415] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.203585] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.203714] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.204639] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.204856] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.205104] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1327.205232] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1327.205352] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1327.205469] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1327.205587] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1327.205700] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1327.205841] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1327.254038] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1327.254605] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1327.254605] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1327.254605] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.254881] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.255076] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.255848] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.255848] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.255848] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.689231] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.759132] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.759689] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.760037] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.760423] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.760790] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.761181] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d not found, creating... [ 1327.762663] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.763044] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.763266] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.763599] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.763850] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.764337] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.764578] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.764743] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.765108] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.765345] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.765554] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d is going to be created. [ 1327.790564] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.790910] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.791152] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.791375] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.791745] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.792326] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.043277] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e in Status: SUCCESS [ 1328.043463] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e deletion is rescheduled due to dependency. [ 1328.043569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.191375] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.191551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.191681] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.191949] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.192085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.192190] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1328.231516] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.231745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.231835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.232118] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.232318] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.243541] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1328.615305] env[61538]: INFO networking_nsxv3.common.synchronization [req-5cac0357-4d81-448f-9d09-ffcbe0f0834e req-e0a59325-c173-46d9-99be-e5ad476d6c73 service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1328.615603] env[61538]: INFO networking_nsxv3.common.synchronization [req-5cac0357-4d81-448f-9d09-ffcbe0f0834e req-e0a59325-c173-46d9-99be-e5ad476d6c73 service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1328.615700] env[61538]: INFO networking_nsxv3.common.synchronization [req-5cac0357-4d81-448f-9d09-ffcbe0f0834e req-e0a59325-c173-46d9-99be-e5ad476d6c73 service nova] Enqueued Resource ID: fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d with Priority: HIGHEST for action port [ 1328.616276] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1328.616412] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1328.616687] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d with Priority: HIGHEST for action port [ 1328.618468] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.618468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.618468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.618468] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.618468] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.619016] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.619128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.619317] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.619408] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.619626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.619806] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.619889] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.122111] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.122543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.123567] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d with status ACTIVE [ 1329.123763] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.123906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.123954] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.124155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.124253] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.124430] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.124529] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.124591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.124742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.124865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.125071] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.125166] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.125227] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.125365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.125441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.125525] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d is going to be updated. [ 1329.150408] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.150610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.150610] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.150795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.150935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.151112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa7b2d4a-22fa-4baa-8d17-381eb5d1ed5d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.253617] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1330.253959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.254109] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.254341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.254529] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.254648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.254711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.254872] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.254960] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.255100] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.763143] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.265244] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.768076] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.768334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.768334] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.768527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.768613] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.768712] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1331.800805] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.801307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.801307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.801482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.801651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.813301] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1331.919607] env[61538]: INFO networking_nsxv3.common.synchronization [req-87169eb0-dbab-4982-a21c-27ca05d08e8a req-5ea8d799-01e3-4718-bdc0-803e5f1e58a7 tempest-ServerActionsTestOtherB-1077210391 tempest-ServerActionsTestOtherB-1077210391-project-member] Enqueued Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1331.920109] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 with Priority: HIGHEST for action security_group_members [ 1331.920477] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-e51a7e95-5364-42cc-944f-ced83c3e81b9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.920581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.920651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.920880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.921320] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.921587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.921701] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.922198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.922198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.922198] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e51a7e95-5364-42cc-944f-ced83c3e81b9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.425750] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.426785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.426785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.426785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.426785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.426785] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.426785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.426785] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.427715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.427715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.427715] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 is going to be updated. [ 1332.464784] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.464784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.464784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.464981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.466629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.478481] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: IN_PROGRESS for 2s [ 1332.595725] env[61538]: INFO networking_nsxv3.common.synchronization [req-3f570a2b-193e-47fc-a9ce-3bfc647c6399 req-cee69180-b38b-484a-911b-5e31ec4f0e28 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1332.596025] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1332.596499] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.597556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.597556] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.597996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.598411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.598539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.598714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.598964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.599069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.599384] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.101798] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.603907] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.823810] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1333.824107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.824656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.824656] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.824656] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.824859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.824859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.824937] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.824984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.825077] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.825171] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.872533] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.872800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.872800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.873528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.873528] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.106827] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.107158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.107285] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.107538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.107694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.107868] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a445d437-8661-4393-ac08-d6abd23acc36 is going to be updated. [ 1334.142380] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.142380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.142380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.142713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.142713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.155060] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: IN_PROGRESS for 2s [ 1334.330177] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.330177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.330177] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.331840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.331840] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.331840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.331840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.331840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.331840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.331840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.331840] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.331840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.332947] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.333097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.333530] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.333647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.333783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.334172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.334383] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.335132] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.335132] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.377866] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.489365] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 in Status: SUCCESS [ 1334.489365] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e51a7e95-5364-42cc-944f-ced83c3e81b9 deletion is rescheduled due to dependency. [ 1334.489365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e51a7e95-5364-42cc-944f-ced83c3e81b9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.838511] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d26186c-7b4f-4430-a869-be9595e84fcc: rpc.has_security_group_logging(os_id): False [ 1334.859281] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.859510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.859510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.859757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.859835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.860056] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.860161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.860224] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.860406] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.860512] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.860697] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.860826] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.860906] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.861070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.861151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.861348] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.861445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.861499] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.861641] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.861783] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.861885] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1334.882047] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.939165] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.939374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.939458] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.939757] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.939986] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.972140] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1335.384762] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1335.384967] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1336.167051] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: SUCCESS [ 1336.167426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.265694] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.265918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.266065] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.266335] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.280796] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1336.281734] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.282826] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1336.324709] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.324988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.325130] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.325453] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.339298] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.341171] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1336.341171] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1336.341171] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1336.392236] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.392393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.392456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.392678] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.394165] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.394347] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1336.488272] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.488515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.488515] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.488667] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.488985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.489354] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1336.583274] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.583553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.583553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.583702] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.583918] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.584257] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:49. [ 1336.584352] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'186c4c09-0cac-4aaf-99ba-5ef21930c905', 'eaf7f2ed-f7df-4976-891c-e301c5c1016e', '1636da8b-a16b-42d3-874d-5d8471397fd6', '04d975b5-946d-46cc-a181-419245c51c87', '3bc3281e-af92-4997-a592-c0e030784b0d', '11ca0972-f93e-4e78-b9f2-0d09798b331c', 'febfb45e-9229-49aa-8dfc-5f90dbca1a4c', 'afd82025-936e-45a1-900c-5fcd4bb713ea', 'e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c', '7fcbd20b-13e3-44c4-bf9a-746a1da000dc', 'c7bff342-c2fc-4ae8-abba-46bb15d334d3', '7d26186c-7b4f-4430-a869-be9595e84fcc', 'b58ef26f-3838-4063-8b99-572a69b4e8cd', 'a445d437-8661-4393-ac08-d6abd23acc36', '7ba62abf-b989-4453-9509-66329821ead3', 'f59fc458-059e-4374-b3e2-7acaf6e64082', '550dcd2b-7021-4904-a80d-13c93ea25fe6', '3e3d8835-25b4-4cc2-a332-a16e5b92a588', '1447a613-37bb-4237-a379-2b84dc1ad40d', '16598403-384b-4b7b-9e19-2f2d3b7596b6', '563f2c80-ee39-48ef-8436-22a95e9bc54a', '463a8c39-ee54-4fb8-a9f5-3967b4233a2e', '8feb07e8-1e39-437e-8497-dad4b8420d11', '2824e3bd-37f2-4e0d-afe6-4e256a5a8cff', '1aac9359-4a9b-4456-9463-ba08a19c23d6', '183bb0f5-0c4a-4a88-8d23-eca114a3a62e', '685f27e5-d19d-4490-b97e-a0015776b51e', '505279a2-0eaf-42f5-83ce-248a1f6eec1d', '9a429894-62fb-4375-9201-aa412f677b75', '6798f697-f08e-4d7d-8b6e-6fb13201518f', '5b226ae7-1968-4740-8cac-2825cb2bf00f', 'fbc4f43e-d331-4f7a-8140-5609ba8b2867', '936eb902-9d4d-4db7-a735-4f3a5141250f', '27cb37c1-ffde-4f82-835b-823e403e1b9e', '0af22a35-c045-464f-ae65-fa54f84e116a', '41199763-c4be-4ed6-bd49-9e22e2390a80', '65ce3e97-db41-488c-9988-1959f1dc1965', 'acdbba8b-e86f-40a9-8892-22733abd6f87', '7c2a68f3-1e90-484c-934f-cd67fcc8be6b', '365fd2af-187a-43da-9017-8bc6e06e1910', '4d15333c-499a-45ad-a20b-dad70f7f90bb', 'ded91e44-4a5f-4d2c-a527-86674f66c321', '500d868a-59d3-4e7e-a5ec-63123eb42a2d', '55b1455b-d54a-44cb-a3ce-90cc7f9dc00b', '6585f491-6358-4615-a571-0639903266ae', 'c83b44db-0e9f-4fe1-b8a5-20122469f727', 'e51a7e95-5364-42cc-944f-ced83c3e81b9', 'c9f9cc04-e7d3-4a55-ba09-c74518d114dc', '580370e7-ea25-4027-912b-de772679071c'} {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1336.584497] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1336.603619] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.603754] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.603852] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.604178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.604276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.604394] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1336.604463] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1336.604545] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1336.699846] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.700007] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.700070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.700279] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.701433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.701747] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1336.701945] env[61538]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61538) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1336.701945] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1336.701945] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1336.702091] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/49 resources of Type:Security Group Rules [ 1336.702178] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGH for action security_group_rules [ 1336.702178] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGH for action security_group_rules [ 1336.702256] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGH for action security_group_rules [ 1336.702347] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGH for action security_group_rules [ 1336.702387] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGH for action security_group_rules [ 1336.702428] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGH for action security_group_rules [ 1336.702471] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGH for action security_group_rules [ 1336.702515] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGH for action security_group_rules [ 1336.702602] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGH for action security_group_rules [ 1336.702645] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGH for action security_group_rules [ 1336.702743] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGH for action security_group_rules [ 1336.702841] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGH for action security_group_rules [ 1336.702841] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGH for action security_group_rules [ 1336.702922] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGH for action security_group_rules [ 1336.703030] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGH for action security_group_rules [ 1336.703070] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGH for action security_group_rules [ 1336.703113] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGH for action security_group_rules [ 1336.703159] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGH for action security_group_rules [ 1336.703206] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGH for action security_group_rules [ 1336.703267] env[61538]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGH for action security_group_rules [ 1336.703364] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.992300] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1336.992560] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.596860] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.597224] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1337.597224] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 with Priority: HIGH for action security_group_rules [ 1337.597224] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGH for action security_group_rules [ 1337.597352] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGH for action security_group_rules [ 1337.597391] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ba62abf-b989-4453-9509-66329821ead3 with Priority: HIGH for action security_group_rules [ 1337.597472] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 with Priority: HIGH for action security_group_rules [ 1337.597570] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1447a613-37bb-4237-a379-2b84dc1ad40d with Priority: HIGH for action security_group_rules [ 1337.597666] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 with Priority: HIGH for action security_group_rules [ 1337.597772] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 with Priority: HIGH for action security_group_rules [ 1337.597865] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGH for action security_group_rules [ 1337.597952] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f59fc458-059e-4374-b3e2-7acaf6e64082 with Priority: HIGH for action security_group_rules [ 1337.598050] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b58ef26f-3838-4063-8b99-572a69b4e8cd with Priority: HIGH for action security_group_rules [ 1337.598139] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGH for action security_group_rules [ 1337.598224] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 with Priority: HIGH for action security_group_rules [ 1337.598310] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc with Priority: HIGH for action security_group_rules [ 1337.598395] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c with Priority: HIGH for action security_group_rules [ 1337.598481] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c with Priority: HIGH for action security_group_rules [ 1337.599329] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd82025-936e-45a1-900c-5fcd4bb713ea with Priority: HIGH for action security_group_rules [ 1337.599498] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc3281e-af92-4997-a592-c0e030784b0d with Priority: HIGH for action security_group_rules [ 1337.599604] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e with Priority: HIGH for action security_group_rules [ 1337.599727] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d975b5-946d-46cc-a181-419245c51c87 with Priority: HIGH for action security_group_rules [ 1337.600074] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-186c4c09-0cac-4aaf-99ba-5ef21930c905 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.600209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.600275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.600486] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.600569] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('186c4c09-0cac-4aaf-99ba-5ef21930c905',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.601529] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.601644] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.601749] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.601966] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.602069] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.602835] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.602934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.603015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.603163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.603330] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.603923] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ba62abf-b989-4453-9509-66329821ead3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.604058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.604135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.604281] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.604344] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ba62abf-b989-4453-9509-66329821ead3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.605021] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16598403-384b-4b7b-9e19-2f2d3b7596b6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.605128] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.605346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.605346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.605416] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16598403-384b-4b7b-9e19-2f2d3b7596b6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.606208] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1447a613-37bb-4237-a379-2b84dc1ad40d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.606306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.606400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.606510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.606578] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1447a613-37bb-4237-a379-2b84dc1ad40d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.607289] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.607418] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.607487] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.607682] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.607718] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3d8835-25b4-4cc2-a332-a16e5b92a588',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.608363] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-550dcd2b-7021-4904-a80d-13c93ea25fe6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.608475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.608540] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.608687] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.608761] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('550dcd2b-7021-4904-a80d-13c93ea25fe6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.609511] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.609619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.609694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.609865] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.609938] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.610844] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f59fc458-059e-4374-b3e2-7acaf6e64082 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.611147] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.611252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.611407] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.611480] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f59fc458-059e-4374-b3e2-7acaf6e64082',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.612213] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b58ef26f-3838-4063-8b99-572a69b4e8cd taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.612384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.612441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.612570] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.612656] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b58ef26f-3838-4063-8b99-572a69b4e8cd',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.613355] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.613459] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.613550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.613662] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.613734] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.616274] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.616435] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.616562] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.616722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.616799] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7bff342-c2fc-4ae8-abba-46bb15d334d3',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.617527] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.617628] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.617695] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.617849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.617919] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fcbd20b-13e3-44c4-bf9a-746a1da000dc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.618733] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.618844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.618909] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.619070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.619143] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.619812] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11ca0972-f93e-4e78-b9f2-0d09798b331c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.619922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.619988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.620152] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.620249] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11ca0972-f93e-4e78-b9f2-0d09798b331c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.621142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afd82025-936e-45a1-900c-5fcd4bb713ea taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.621258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.621324] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.621528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.621528] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afd82025-936e-45a1-900c-5fcd4bb713ea',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.622278] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bc3281e-af92-4997-a592-c0e030784b0d taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.622382] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.622536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.622660] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.622660] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bc3281e-af92-4997-a592-c0e030784b0d',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.623339] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.623440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.623505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.623724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.623793] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaf7f2ed-f7df-4976-891c-e301c5c1016e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.624572] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d975b5-946d-46cc-a181-419245c51c87 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.624724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.624801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.625012] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.625101] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d975b5-946d-46cc-a181-419245c51c87',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.650812] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.651033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.651033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.651258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.653263] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.653375] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.672964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.673197] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16598403-384b-4b7b-9e19-2f2d3b7596b6 is going to be deleted. [ 1337.674049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.674272] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.695505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.695695] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f59fc458-059e-4374-b3e2-7acaf6e64082 is going to be deleted. [ 1337.754360] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.754585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.754585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.754777] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.754878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.755156] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16598403-384b-4b7b-9e19-2f2d3b7596b6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.769237] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.769438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.769438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.769726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.769849] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.769929] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f59fc458-059e-4374-b3e2-7acaf6e64082" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.131520] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.131748] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.131804] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.132067] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.132256] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.132370] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.132434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.132604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.132715] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.132823] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.132919] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.141303] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.141485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.141485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.141685] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.141844] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.141951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.142033] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.142161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.142240] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.142322] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.142395] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.146999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.147172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.147254] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.147372] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.147526] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.147631] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.147714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.147860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.147942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.148049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.148464] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.159263] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.159440] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.159514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.159724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.159882] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.159979] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.160080] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.160267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.160384] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.160496] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.160680] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.160800] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.160880] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.161075] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.161246] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.161365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.161447] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.161591] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.161672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.161779] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.161873] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.224953] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.225216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.225305] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.225532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.227588] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.227710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.228799] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.228950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.230378] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.230511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.231567] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.231730] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.232806] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.232946] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.234363] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.234510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.235524] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.235665] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.236668] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.236811] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.241972] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.242176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.250993] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.251233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.252232] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1338.252895] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.253126] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.254561] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1338.255155] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.255284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.256270] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1338.256863] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.257085] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.258028] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1338.258524] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.258753] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.259503] env[61538]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1338.260048] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.260248] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c is going to be deleted. [ 1338.261410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.261756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.288494] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.288709] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ba62abf-b989-4453-9509-66329821ead3 is going to be deleted. [ 1338.289569] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.289802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.312644] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.312875] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11ca0972-f93e-4e78-b9f2-0d09798b331c is going to be deleted. [ 1338.313714] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.314193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.339980] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.340241] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.343068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.343068] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1447a613-37bb-4237-a379-2b84dc1ad40d is going to be deleted. [ 1338.343860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.344149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.370646] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.370854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.373446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.373607] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fcbd20b-13e3-44c4-bf9a-746a1da000dc is going to be deleted. [ 1338.374773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.375025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.403073] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.403221] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.404677] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.404806] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afd82025-936e-45a1-900c-5fcd4bb713ea is going to be deleted. [ 1338.405795] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.406151] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.430999] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.431143] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.432514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.432638] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b58ef26f-3838-4063-8b99-572a69b4e8cd is going to be deleted. [ 1338.433582] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.433801] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.455738] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.455934] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.506320] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.506320] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be deleted. [ 1338.507223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.512859] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.577160] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.577619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.599163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.599163] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d975b5-946d-46cc-a181-419245c51c87 is going to be deleted. [ 1338.599477] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.599557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.644500] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.650271] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.652229] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.652368] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.669339] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d26186c-7b4f-4430-a869-be9595e84fcc: rpc.has_security_group_logging(os_id): False [ 1338.693753] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.693917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.724986] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.725131] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.726442] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.726564] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7bff342-c2fc-4ae8-abba-46bb15d334d3 is going to be deleted. [ 1338.727763] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.727991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.782230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.782441] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.797387] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.797569] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 550dcd2b-7021-4904-a80d-13c93ea25fe6 is going to be deleted. [ 1338.798593] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.798847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.853768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.854018] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bc3281e-af92-4997-a592-c0e030784b0d is going to be deleted. [ 1338.854923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.855178] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.869769] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.870094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.908875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.909105] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaf7f2ed-f7df-4976-891c-e301c5c1016e is going to be deleted. [ 1338.909945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.910169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.978890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.979160] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 186c4c09-0cac-4aaf-99ba-5ef21930c905 is going to be deleted. [ 1338.979988] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.980217] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.001379] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.001696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.002401] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.002563] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.013578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.013796] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3d8835-25b4-4cc2-a332-a16e5b92a588 is going to be deleted. [ 1339.015245] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.015568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.015713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.015907] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23dcb6e-5990-4fd2-b0a5-6de59e1ac05c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.016167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.016410] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.016532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.016700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ba62abf-b989-4453-9509-66329821ead3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.017700] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.017930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.018072] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.018251] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11ca0972-f93e-4e78-b9f2-0d09798b331c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.018445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.018653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.018775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.018940] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1447a613-37bb-4237-a379-2b84dc1ad40d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.019155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.019367] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.019481] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.019716] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fcbd20b-13e3-44c4-bf9a-746a1da000dc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.019930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.020158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.020276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.020438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afd82025-936e-45a1-900c-5fcd4bb713ea" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.020626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.020832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.020939] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.021124] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b58ef26f-3838-4063-8b99-572a69b4e8cd" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.021306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.021506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.021616] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.021928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.022269] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.022394] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.080936] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.081172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.101141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.101426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.101542] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.101612] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.101890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.101963] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.102189] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.102291] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.102354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.102502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.102576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.102803] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.102899] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.102959] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.103121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.103200] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.103296] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1339.104389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.104554] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.104640] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.104755] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d975b5-946d-46cc-a181-419245c51c87" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.104890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.105038] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.105117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.105233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7bff342-c2fc-4ae8-abba-46bb15d334d3" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.105389] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.105527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.105602] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.105713] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-550dcd2b-7021-4904-a80d-13c93ea25fe6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.105832] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.105965] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.106054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.106157] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bc3281e-af92-4997-a592-c0e030784b0d" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.106807] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.107015] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.107114] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.107284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaf7f2ed-f7df-4976-891c-e301c5c1016e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.141585] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.141874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.142084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.142405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.142548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.142745] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-186c4c09-0cac-4aaf-99ba-5ef21930c905" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.147250] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a445d437-8661-4393-ac08-d6abd23acc36: rpc.has_security_group_logging(os_id): False [ 1339.153976] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for febfb45e-9229-49aa-8dfc-5f90dbca1a4c: rpc.has_security_group_logging(os_id): False [ 1339.189939] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.190176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.190176] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.190333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.190424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.190550] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3d8835-25b4-4cc2-a332-a16e5b92a588" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.224813] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.225159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.225159] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.225424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.230605] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.230773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.291034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.291034] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.291034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.291034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.291034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.291034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.291034] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c is going to be updated. [ 1339.292185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.292380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.341766] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.341926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.344911] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.345231] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.345333] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.345401] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.345609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.345694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.345783] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a445d437-8661-4393-ac08-d6abd23acc36 is going to be updated. [ 1339.346860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.347063] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.347215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.420530] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1339.488165] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.488565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.488565] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.488842] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.489315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.520032] env[61538]: INFO networking_nsxv3.common.synchronization [req-059da6ed-b172-4f9a-847a-57d888659458 req-585517ad-0581-4f40-96b1-24421718f550 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1339.520571] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1339.521078] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.521215] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.521299] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.521530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.521812] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.522096] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.522230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.523198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.523198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.523198] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.542262] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.542262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.542262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.542262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.542262] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.557939] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: IN_PROGRESS for 2s [ 1339.575622] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: IN_PROGRESS for 2s [ 1340.025759] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.528416] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.846360] env[61538]: INFO networking_nsxv3.common.synchronization [req-27748f83-14f7-4b18-9e44-2011f461ba27 req-91a22d6c-9914-4117-ab38-47430d2e57fe tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1340.847377] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a445d437-8661-4393-ac08-d6abd23acc36 with Priority: HIGHEST for action security_group_members [ 1340.849207] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-a445d437-8661-4393-ac08-d6abd23acc36 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.849400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.849508] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.850149] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.850149] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.850317] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.850317] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.850511] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.850639] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.850779] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a445d437-8661-4393-ac08-d6abd23acc36',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.033036] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.033505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.033505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.033505] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.033733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.033733] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1341.065466] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.065643] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.065711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.065924] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.066092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.076382] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1341.353223] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.353223] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.353568] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.353629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.354516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.354516] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.354516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.354516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.354516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.354516] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.354516] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a445d437-8661-4393-ac08-d6abd23acc36 is going to be updated. [ 1341.385668] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.385873] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.385920] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.386115] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.386502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.395240] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: IN_PROGRESS for 2s [ 1341.440438] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1341.440674] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.572572] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: SUCCESS [ 1341.572816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.592663] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: SUCCESS [ 1341.592950] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.513551] env[61538]: INFO networking_nsxv3.common.synchronization [None req-cb39cb43-eb68-472d-8766-c339e90762da tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 42fbf405-7b90-4348-baa8-1af640a171c8 with Priority: HIGHEST for action security_group_rules [ 1342.514142] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42fbf405-7b90-4348-baa8-1af640a171c8 with Priority: HIGHEST for action security_group_rules [ 1342.514389] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42fbf405-7b90-4348-baa8-1af640a171c8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.514514] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42fbf405-7b90-4348-baa8-1af640a171c8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.514581] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42fbf405-7b90-4348-baa8-1af640a171c8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.514871] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42fbf405-7b90-4348-baa8-1af640a171c8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.514958] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42fbf405-7b90-4348-baa8-1af640a171c8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.586478] env[61538]: INFO networking_nsxv3.common.synchronization [None req-d7ba2825-09ef-4997-a8e4-4308565be973 tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 42fbf405-7b90-4348-baa8-1af640a171c8 with Priority: HIGHEST for action security_group_rules [ 1342.587059] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42fbf405-7b90-4348-baa8-1af640a171c8 with Priority: HIGHEST for action security_group_rules [ 1342.587337] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42fbf405-7b90-4348-baa8-1af640a171c8 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.587524] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42fbf405-7b90-4348-baa8-1af640a171c8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.041657] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.041875] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.041938] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.042140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.042236] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.042338] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42fbf405-7b90-4348-baa8-1af640a171c8 already deleted. [ 1343.042424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42fbf405-7b90-4348-baa8-1af640a171c8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.042572] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42fbf405-7b90-4348-baa8-1af640a171c8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.042722] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42fbf405-7b90-4348-baa8-1af640a171c8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.042809] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42fbf405-7b90-4348-baa8-1af640a171c8',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.086761] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1343.087187] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.406067] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a445d437-8661-4393-ac08-d6abd23acc36 in Status: SUCCESS [ 1343.406313] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a445d437-8661-4393-ac08-d6abd23acc36 deletion is rescheduled due to dependency. [ 1343.406404] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a445d437-8661-4393-ac08-d6abd23acc36" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.576676] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.577264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.577264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.577590] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.577703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.577762] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42fbf405-7b90-4348-baa8-1af640a171c8 already deleted. [ 1343.577814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42fbf405-7b90-4348-baa8-1af640a171c8" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.615044] env[61538]: INFO networking_nsxv3.common.synchronization [req-4ae1ed87-74e4-4be5-ad1e-5b5aca47811e req-10923c9a-03f3-46c5-a238-bbf2d7d05f46 tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1345.615805] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1345.616287] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.616457] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.616945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.616945] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.617208] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.617271] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.617315] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.617539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.617676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.617822] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.120499] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.120726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.120726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.120949] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.142185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.142426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.142586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.142586] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.142792] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.142869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.142978] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1346.187949] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.188158] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.188209] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.188482] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.188623] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.198058] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1346.494509] env[61538]: INFO networking_nsxv3.common.synchronization [None req-9b1193e8-633c-44d3-9637-76b11b377c30 tempest-AttachInterfacesTestJSON-1792420423 tempest-AttachInterfacesTestJSON-1792420423-project-member] Enqueued Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1346.495050] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 with Priority: HIGHEST for action security_group_members [ 1346.495365] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-1636da8b-a16b-42d3-874d-5d8471397fd6 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.495491] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.495557] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.495750] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.495908] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.496018] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.496069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.496258] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.496306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.496380] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1636da8b-a16b-42d3-874d-5d8471397fd6',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.998816] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.999169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.999169] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.999314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.999431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.999676] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.999843] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.999922] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.000094] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.000175] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.000339] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1636da8b-a16b-42d3-874d-5d8471397fd6 is going to be deleted. [ 1347.039747] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.039747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.039747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.039747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.039747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.039747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1636da8b-a16b-42d3-874d-5d8471397fd6" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.211209] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1348.211580] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e deletion is rescheduled due to dependency. [ 1348.211580] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.194557] env[61538]: INFO networking_nsxv3.common.synchronization [None req-5384f8ef-5cdb-460f-9994-f7a8191e6150 None None] Enqueued Resource ID: 49619eec-87f1-4a89-a9c0-6cd04ed72ced with Priority: HIGHEST for action port [ 1351.194852] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49619eec-87f1-4a89-a9c0-6cd04ed72ced with Priority: HIGHEST for action port [ 1351.195261] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-49619eec-87f1-4a89-a9c0-6cd04ed72ced taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.195397] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49619eec-87f1-4a89-a9c0-6cd04ed72ced" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.195566] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49619eec-87f1-4a89-a9c0-6cd04ed72ced" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.195726] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49619eec-87f1-4a89-a9c0-6cd04ed72ced" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.195813] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49619eec-87f1-4a89-a9c0-6cd04ed72ced',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.339570] env[61538]: INFO networking_nsxv3.common.synchronization [None req-eca6effb-641c-48be-a691-622389c2b213 tempest-ServersTestManualDisk-1260630413 tempest-ServersTestManualDisk-1260630413-project-member] Enqueued Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_rules [ 1351.340168] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_rules [ 1351.340407] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-215b3675-f3e8-4643-8265-ee6bab0775d9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.340532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.340607] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.340850] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.340933] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.354430] env[61538]: INFO networking_nsxv3.common.synchronization [req-e6e2ab04-35af-43cb-bc3f-b663dda91e97 req-1c51983d-df56-4699-98ea-8589a37225ba tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1351.354430] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1351.355341] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.355341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.355341] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.355632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.355632] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.355632] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.355769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.355769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.355848] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.355949] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.420174] env[61538]: INFO networking_nsxv3.common.synchronization [None req-be614153-a8ba-43d4-9a69-8a75844df857 tempest-ServersTestManualDisk-1260630413 tempest-ServersTestManualDisk-1260630413-project-member] Enqueued Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_rules [ 1351.420174] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_rules [ 1351.420174] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-215b3675-f3e8-4643-8265-ee6bab0775d9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.420174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.698630] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49619eec-87f1-4a89-a9c0-6cd04ed72ced [ 1351.698890] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.699076] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.699161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.699891] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.699891] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.699891] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49619eec-87f1-4a89-a9c0-6cd04ed72ced already deleted. [ 1351.699891] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49619eec-87f1-4a89-a9c0-6cd04ed72ced" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.707494] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.707809] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.708029] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.708373] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.708700] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.708930] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.709129] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.709420] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.709910] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.710118] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1351.710167] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1351.710341] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1351.710504] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1351.710670] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1351.710827] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1351.711091] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1351.734757] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1351.734937] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1351.735155] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1351.735385] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.735758] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-f859288c-a2db-438a-8bdb-5c2669003b88 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.735989] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-f859288c-a2db-438a-8bdb-5c2669003b88" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.736178] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-f859288c-a2db-438a-8bdb-5c2669003b88" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.736541] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-f859288c-a2db-438a-8bdb-5c2669003b88" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.736721] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f859288c-a2db-438a-8bdb-5c2669003b88',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.858431] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.858606] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.858669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.858905] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.859030] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.859271] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.859395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.859451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.859633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.859711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.859971] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1351.866492] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.866648] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.866696] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.866894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.866984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.867109] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 already deleted. [ 1351.867226] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.867380] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.868451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.868574] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.896544] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.896544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.896544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.896544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.896544] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.906768] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1352.240857] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.242088] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.242396] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.242748] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.244684] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.244684] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port f859288c-a2db-438a-8bdb-5c2669003b88 not found, creating... [ 1352.244684] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.244684] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.244684] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.244684] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.244684] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.246429] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.246615] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.246744] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.246971] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.247137] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.247289] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: f859288c-a2db-438a-8bdb-5c2669003b88 is going to be created. [ 1352.273064] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.273064] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.273064] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.273064] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.273064] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.273064] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-f859288c-a2db-438a-8bdb-5c2669003b88" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.403261] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.403463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.403463] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.403689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.403834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.404028] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 already deleted. [ 1352.404028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.282285] env[61538]: INFO networking_nsxv3.common.synchronization [req-e6e2ab04-35af-43cb-bc3f-b663dda91e97 req-968ae024-5437-4167-87a4-21689e067b41 service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1353.282565] env[61538]: INFO networking_nsxv3.common.synchronization [req-e6e2ab04-35af-43cb-bc3f-b663dda91e97 req-968ae024-5437-4167-87a4-21689e067b41 service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1353.282690] env[61538]: INFO networking_nsxv3.common.synchronization [req-e6e2ab04-35af-43cb-bc3f-b663dda91e97 req-968ae024-5437-4167-87a4-21689e067b41 service nova] Enqueued Resource ID: f859288c-a2db-438a-8bdb-5c2669003b88 with Priority: HIGHEST for action port [ 1353.283186] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1353.283325] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1353.283423] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f859288c-a2db-438a-8bdb-5c2669003b88 with Priority: HIGHEST for action port [ 1353.283689] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.283844] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.283991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.284475] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.284657] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.285410] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.285512] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.285699] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-f859288c-a2db-438a-8bdb-5c2669003b88 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.285805] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f859288c-a2db-438a-8bdb-5c2669003b88" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.285869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f859288c-a2db-438a-8bdb-5c2669003b88" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.286204] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f859288c-a2db-438a-8bdb-5c2669003b88" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.286204] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f859288c-a2db-438a-8bdb-5c2669003b88',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.501594] env[61538]: INFO networking_nsxv3.common.synchronization [None req-04040736-8c86-4eb3-8fd2-1a6e3cd28b8b None None] Enqueued Resource ID: cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0 with Priority: HIGHEST for action port [ 1353.502172] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0 with Priority: HIGHEST for action port [ 1353.502483] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.502609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.502673] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.502931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.504218] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.631722] env[61538]: INFO networking_nsxv3.common.synchronization [req-32e2156a-ea67-4bd6-bbb1-0cd34f113a51 req-1006a741-5c49-4a92-b2fb-b9935a53f4f1 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1353.632356] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1353.633009] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.633261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.633261] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.633455] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.633739] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.633739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.633739] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.633878] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.634205] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.634205] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.790137] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.790137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.790137] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f859288c-a2db-438a-8bdb-5c2669003b88 with status ACTIVE [ 1353.790137] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.790137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.790137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.790137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.790137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.790137] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.790137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.790137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.790137] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.790710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.790710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.790710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.790710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.790710] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.790981] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.790981] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f859288c-a2db-438a-8bdb-5c2669003b88 is going to be updated. [ 1353.816601] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.816814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.816814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.817146] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.817250] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.817373] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f859288c-a2db-438a-8bdb-5c2669003b88" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.990819] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.991052] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.991195] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.991474] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.991740] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.991925] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.992294] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.992523] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.992677] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.992893] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1353.993047] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1353.993178] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1353.993293] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1353.993409] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1353.993520] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1353.993656] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1354.003100] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1354.003283] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e deletion is rescheduled due to dependency. [ 1354.003398] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.003545] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.003742] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.004393] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.004393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.004393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.004393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.004393] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.004393] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.006014] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0 [ 1354.006104] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.006172] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.006230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.006365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.006417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.006533] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0 already deleted. [ 1354.006576] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf123c6a-e42e-410b-8c5e-46f2bdeeb4a0" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.016614] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1354.016799] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1354.016946] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1354.017286] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-23" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.017468] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-2ff38b08-dfa0-4c6f-946d-b496a5074f97 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.017645] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-2ff38b08-dfa0-4c6f-946d-b496a5074f97" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.017766] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-2ff38b08-dfa0-4c6f-946d-b496a5074f97" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.018110] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-2ff38b08-dfa0-4c6f-946d-b496a5074f97" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.018264] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ff38b08-dfa0-4c6f-946d-b496a5074f97',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.136695] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.506820] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.521845] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.521845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.521845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.521845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.521845] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.521845] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 2ff38b08-dfa0-4c6f-946d-b496a5074f97 not found, creating... [ 1354.522229] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.522416] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.522474] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.522690] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.522975] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.523222] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.523554] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.523554] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.523774] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.523774] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.523909] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 2ff38b08-dfa0-4c6f-946d-b496a5074f97 is going to be created. [ 1354.551212] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.551454] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.551590] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.551934] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.552200] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.552432] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-2ff38b08-dfa0-4c6f-946d-b496a5074f97" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.639405] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.009441] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.146031] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.146031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.146031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.146031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.146031] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.146031] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1355.185411] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.185411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.185411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.185411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.185411] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.207274] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1355.275168] env[61538]: INFO networking_nsxv3.common.synchronization [req-32e2156a-ea67-4bd6-bbb1-0cd34f113a51 req-318726a8-7728-4d25-8d50-220c20f0474e service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1355.275516] env[61538]: INFO networking_nsxv3.common.synchronization [req-32e2156a-ea67-4bd6-bbb1-0cd34f113a51 req-318726a8-7728-4d25-8d50-220c20f0474e service nova] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1355.275784] env[61538]: INFO networking_nsxv3.common.synchronization [req-32e2156a-ea67-4bd6-bbb1-0cd34f113a51 req-318726a8-7728-4d25-8d50-220c20f0474e service nova] Enqueued Resource ID: 2ff38b08-dfa0-4c6f-946d-b496a5074f97 with Priority: HIGHEST for action port [ 1355.276577] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_rules [ 1355.276835] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1355.277081] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff38b08-dfa0-4c6f-946d-b496a5074f97 with Priority: HIGHEST for action port [ 1355.277564] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.277732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.277882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.278160] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.278311] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.279689] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.279803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.282230] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ff38b08-dfa0-4c6f-946d-b496a5074f97 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.282230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ff38b08-dfa0-4c6f-946d-b496a5074f97" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.282230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ff38b08-dfa0-4c6f-946d-b496a5074f97" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.282230] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ff38b08-dfa0-4c6f-946d-b496a5074f97" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.282230] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ff38b08-dfa0-4c6f-946d-b496a5074f97',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.512379] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.512816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.512816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.512816] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.512958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.513025] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1355.561916] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.562121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.562260] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.562417] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.562597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.573892] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1355.785492] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.785492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.785492] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ff38b08-dfa0-4c6f-946d-b496a5074f97 with status ACTIVE [ 1355.785492] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.785492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.785492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.785492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.785926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.785926] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.785926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.785926] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.786084] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.786120] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.786307] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.786400] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.786460] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.786596] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.786669] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.786752] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ff38b08-dfa0-4c6f-946d-b496a5074f97 is going to be updated. [ 1355.808502] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.808703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.808703] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.808925] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.809107] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.809247] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ff38b08-dfa0-4c6f-946d-b496a5074f97" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.117142] env[61538]: INFO networking_nsxv3.common.synchronization [req-3fca7915-bf4a-452d-aa00-28b98d239351 req-fa49a0ce-0f5d-4dca-8802-f45bb9e7c09f tempest-ServersTestManualDisk-1260630413 tempest-ServersTestManualDisk-1260630413-project-member] Enqueued Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_members [ 1357.117142] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_members [ 1357.117142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-215b3675-f3e8-4643-8265-ee6bab0775d9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.117142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.117142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.117142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.117142] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.117142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.117142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.117142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.117142] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.117142] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.250579] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1357.251101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.251101] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.251326] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.251471] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.251609] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.251671] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.251834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.251941] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.252064] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.511118] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.511371] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-738" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.511505] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-738" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.511848] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-738" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.512425] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.512652] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.512878] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.513268] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.513520] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.513788] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1357.513915] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1357.514191] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1357.514232] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1357.514353] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1357.514504] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1357.514656] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1357.535717] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1357.535931] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1357.536066] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1357.536265] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-738" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.536606] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-62ea8d65-9aae-4400-998b-1a364d16dfcb taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.536788] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-62ea8d65-9aae-4400-998b-1a364d16dfcb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.536915] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-62ea8d65-9aae-4400-998b-1a364d16dfcb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.537313] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-62ea8d65-9aae-4400-998b-1a364d16dfcb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.537463] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62ea8d65-9aae-4400-998b-1a364d16dfcb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.584897] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1357.585155] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.585327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.585555] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.585758] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.585991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.585991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.586145] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.586233] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.586323] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.586418] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.620100] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.620309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.620309] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.620530] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.620618] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.620820] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.620923] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.620984] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.621139] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.621219] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.621303] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 already deleted. [ 1357.621390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.754685] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.040508] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.040942] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.040942] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.041206] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.041370] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.041539] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 62ea8d65-9aae-4400-998b-1a364d16dfcb not found, creating... [ 1358.041857] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.042091] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.042227] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.042485] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.042635] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.042974] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.043182] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.043309] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.043583] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.043766] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.043920] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 62ea8d65-9aae-4400-998b-1a364d16dfcb is going to be created. [ 1358.068248] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.068468] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.068598] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.069193] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.069193] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.069418] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-62ea8d65-9aae-4400-998b-1a364d16dfcb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.089042] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.089042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.089042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.089390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.089574] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.089689] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.089759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.090058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.090201] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.090306] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.090474] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.090578] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.090642] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.090803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.090949] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.091057] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.091113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.091292] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.091379] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.091465] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.091558] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.259088] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.594413] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 685f27e5-d19d-4490-b97e-a0015776b51e: rpc.has_security_group_logging(os_id): False [ 1358.615470] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.615706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.615706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.615935] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.615994] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.616242] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.616390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.616390] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.616548] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.616625] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.616876] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.617050] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.617112] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.617537] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.617856] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.618205] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.618430] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.618604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.618874] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.619068] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.619272] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1358.690608] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.690776] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.690818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.691040] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.691188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.708136] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1358.761641] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.761862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.761862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.762267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.762267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.762463] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1358.778703] env[61538]: INFO networking_nsxv3.common.synchronization [req-3fca7915-bf4a-452d-aa00-28b98d239351 req-0fc1fce5-090c-4fd7-8aa4-1a81e7a8a0d5 service nova] Enqueued Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_rules [ 1358.778897] env[61538]: INFO networking_nsxv3.common.synchronization [req-3fca7915-bf4a-452d-aa00-28b98d239351 req-0fc1fce5-090c-4fd7-8aa4-1a81e7a8a0d5 service nova] Enqueued Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_members [ 1358.779125] env[61538]: INFO networking_nsxv3.common.synchronization [req-3fca7915-bf4a-452d-aa00-28b98d239351 req-0fc1fce5-090c-4fd7-8aa4-1a81e7a8a0d5 service nova] Enqueued Resource ID: 62ea8d65-9aae-4400-998b-1a364d16dfcb with Priority: HIGHEST for action port [ 1358.779606] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_rules [ 1358.780379] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_members [ 1358.780521] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ea8d65-9aae-4400-998b-1a364d16dfcb with Priority: HIGHEST for action port [ 1358.780846] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-215b3675-f3e8-4643-8265-ee6bab0775d9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.781011] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.781089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.781350] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.781492] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.782526] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-215b3675-f3e8-4643-8265-ee6bab0775d9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.782732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.782732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.782928] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.783101] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.783198] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.783259] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.783420] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.783510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.783635] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.785194] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-62ea8d65-9aae-4400-998b-1a364d16dfcb taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.785369] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62ea8d65-9aae-4400-998b-1a364d16dfcb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.785470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62ea8d65-9aae-4400-998b-1a364d16dfcb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.785724] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62ea8d65-9aae-4400-998b-1a364d16dfcb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.785826] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62ea8d65-9aae-4400-998b-1a364d16dfcb',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.812531] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.812732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.812838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.813141] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.813347] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.832239] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1359.292054] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.293379] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-215b3675-f3e8-4643-8265-ee6bab0775d9 taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.293503] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.293883] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62ea8d65-9aae-4400-998b-1a364d16dfcb with status ACTIVE [ 1359.294061] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.294174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.294249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.294450] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.294541] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.294707] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.294802] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.294862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.295034] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.295117] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.295416] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.295416] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.295527] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.295603] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.295676] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.295758] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62ea8d65-9aae-4400-998b-1a364d16dfcb is going to be updated. [ 1359.318232] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.318434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.318434] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.318594] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.318729] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.318890] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62ea8d65-9aae-4400-998b-1a364d16dfcb" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.794449] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.298140] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.298140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.298140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.298140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.298140] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.298745] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 is going to be created. [ 1360.323398] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.323630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.323630] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.323803] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.323961] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.334188] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 in Status: UNINITIALIZED for 2s [ 1360.734097] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1360.734426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.844220] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1360.844492] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.845197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.845431] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.845660] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.845770] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.845847] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.846025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.846106] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.846216] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.846357] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.348628] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.349092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.349092] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.349287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.349547] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.349704] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.349775] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.350113] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.350276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.350466] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.350699] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.350862] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.350931] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.351047] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.351199] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.351328] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.351405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.351553] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.351672] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.351793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.351890] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.854750] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d26186c-7b4f-4430-a869-be9595e84fcc: rpc.has_security_group_logging(os_id): False [ 1361.875336] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.875834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.875834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.875834] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.876049] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.876171] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.876314] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.876360] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.877991] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.877991] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.877991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.877991] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1361.947734] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.947978] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.948133] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.948451] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.948663] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.977694] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1362.346069] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 in Status: SUCCESS [ 1362.346069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.346069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.346362] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.346404] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.346694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.346694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.346694] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.346996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.346996] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.346996] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.849533] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.352756] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 215b3675-f3e8-4643-8265-ee6bab0775d9: rpc.has_security_group_logging(os_id): False [ 1363.373110] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.373424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.373424] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.373645] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.373778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.374085] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.374268] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.374355] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.374469] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.374709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.374709] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 is going to be created. [ 1363.444302] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.444521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.444521] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.444743] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.444861] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.456723] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 in Status: IN_PROGRESS for 2s [ 1363.781834] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.782010] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1364.000227] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1364.000633] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.471945] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 in Status: SUCCESS [ 1365.472473] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.782960] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.783386] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.378057] env[61538]: INFO networking_nsxv3.common.synchronization [req-34192185-6deb-419d-ab3d-319f6f77b6dd req-3e6f2eac-2deb-4c18-b9ac-89c8b1c2bd40 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1369.378586] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1369.378889] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.379025] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.379105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.379287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.379441] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.379551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.379597] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.379725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.379810] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.379903] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.740018] env[61538]: INFO networking_nsxv3.common.synchronization [req-8fadf053-de27-450c-ad01-10e8a84d3482 req-45804eca-afb4-4bd8-8645-1eef04cdae15 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 1369.740018] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 1369.740018] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.740438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.740638] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.740957] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.741265] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.741884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.741884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.741884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.741884] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.742135] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.883420] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.243953] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.385880] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.746066] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.888167] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.888497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.888497] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.888611] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.888706] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.888807] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1370.929785] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.929992] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.930070] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.930252] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.930399] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.938879] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1371.248601] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.248758] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.248854] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.249056] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.249153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.249252] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c is going to be updated. [ 1371.275044] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.275249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.275249] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.275427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.275551] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.285047] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: IN_PROGRESS for 2s [ 1372.949853] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1372.950275] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.295896] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: SUCCESS [ 1373.296135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.740289] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.740629] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.143924] env[61538]: INFO networking_nsxv3.common.synchronization [req-be9fb1b7-583b-4c34-b552-87a35362891e req-29e9c20a-133a-4f84-b1bc-5acbc02bdd33 tempest-ServersTestJSON-512759938 tempest-ServersTestJSON-512759938-project-member] Enqueued Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1376.144842] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d26186c-7b4f-4430-a869-be9595e84fcc with Priority: HIGHEST for action security_group_members [ 1376.145209] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d26186c-7b4f-4430-a869-be9595e84fcc taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.145361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.145445] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.145647] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.146046] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.146046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.146046] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.146312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.146312] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.146312] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d26186c-7b4f-4430-a869-be9595e84fcc',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.648286] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.648510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.648510] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.648725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.648821] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.649026] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.649135] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.649199] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.649354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.649433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.649524] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc is going to be updated. [ 1376.680805] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.680991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.680991] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.681188] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.681336] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.690521] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: IN_PROGRESS for 2s [ 1378.707651] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d26186c-7b4f-4430-a869-be9595e84fcc in Status: SUCCESS [ 1378.707651] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d26186c-7b4f-4430-a869-be9595e84fcc deletion is rescheduled due to dependency. [ 1378.707651] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d26186c-7b4f-4430-a869-be9595e84fcc" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.145663] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.146189] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.146470] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.146861] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.569439] env[61538]: INFO networking_nsxv3.common.synchronization [req-73b18eec-2f39-4ac9-86bc-bbb6d54b0e6c req-8ec43425-96dc-4ddd-ab2b-7cb2851d80f6 tempest-ServerActionsTestOtherA-1294261184 tempest-ServerActionsTestOtherA-1294261184-project-member] Enqueued Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 1386.569961] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c with Priority: HIGHEST for action security_group_members [ 1386.570359] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.570490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.570559] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.570759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.570912] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.571013] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.571194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.571346] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.571433] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.571528] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('febfb45e-9229-49aa-8dfc-5f90dbca1a4c',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.074213] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.074479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.074479] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.074725] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.074838] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.075083] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.075197] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.075276] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.075446] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.075531] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.075630] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c is going to be updated. [ 1387.105765] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.106024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.106024] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.106185] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.106395] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.115755] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: IN_PROGRESS for 2s [ 1389.138021] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c in Status: SUCCESS [ 1389.138538] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: febfb45e-9229-49aa-8dfc-5f90dbca1a4c deletion is rescheduled due to dependency. [ 1389.138538] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-febfb45e-9229-49aa-8dfc-5f90dbca1a4c" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.411455] env[61538]: INFO networking_nsxv3.common.synchronization [req-e53c90ea-a8b9-4601-9734-c2b0fedc8f39 req-339389cb-35a6-4fd0-931d-13380c239442 tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1390.412018] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1390.412438] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.412768] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.412840] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.413054] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.413214] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.413361] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.413427] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.413579] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.413664] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.413842] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.915556] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.915769] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.915860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.916069] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.916153] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.916752] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.916877] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.916930] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.917105] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.917186] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.917273] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1390.948437] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.948653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.948653] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.948860] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.949023] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.958319] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1392.969741] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1392.970102] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e deletion is rescheduled due to dependency. [ 1392.970161] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.055255] env[61538]: INFO networking_nsxv3.common.synchronization [req-2ae6dcb0-7906-41c1-ba15-b6bebc5f416a req-4ee92b43-2348-4c45-a521-700fc8156b6d tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1393.055791] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1393.056109] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.056234] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.056302] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.056502] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.056643] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.056747] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.056830] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.056983] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.057088] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.057184] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.325686] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.325914] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.326092] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.326522] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.326899] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.327360] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.327513] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.327880] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.328095] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.328333] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1393.328458] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] NeedRegenerationException {{(pid=61538) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1393.328578] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] no value, waiting for create lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1393.328695] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] value creation lock acquired {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1393.328814] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] No value present for key: 'zone-id' {{(pid=61538) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1393.328928] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Calling creation function for not-yet-present value {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1393.329085] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1393.348706] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1393.348901] env[61538]: DEBUG dogpile.cache.region [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=61538) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1393.349033] env[61538]: DEBUG dogpile.lock [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Released creation lock {{(pid=61538) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1393.349239] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "network-562" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.349580] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock port-73eaa178-06d6-45cf-bf15-28ff642a115e taken with stack trace [, , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.349775] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "port-73eaa178-06d6-45cf-bf15-28ff642a115e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.349899] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "port-73eaa178-06d6-45cf-bf15-28ff642a115e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.350299] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "port-73eaa178-06d6-45cf-bf15-28ff642a115e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.350490] env[61538]: DEBUG networking_nsxv3.api.rpc [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73eaa178-06d6-45cf-bf15-28ff642a115e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.561042] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.561042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.561042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.561042] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.561426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.561426] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.561426] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.561552] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.561759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.561759] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.561838] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1393.593674] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.593885] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.593985] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.594307] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.594490] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.603556] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1393.852552] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.852786] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.852979] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.853378] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.853612] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.853838] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Segment Port 73eaa178-06d6-45cf-bf15-28ff642a115e not found, creating... [ 1393.854170] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.854383] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.854541] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.854810] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.854992] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.855343] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.855583] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.855773] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.856020] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.856175] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.856324] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Resource: SegmentPort with ID: 73eaa178-06d6-45cf-bf15-28ff642a115e is going to be created. [ 1393.881501] env[61538]: DEBUG networking_nsxv3.common.locking [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.881787] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.881922] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.882247] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.882519] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.882755] env[61538]: DEBUG oslo_concurrency.lockutils [None req-19f176b3-97c2-4a8e-a23b-740f1679483a None None] Releasing lock "port-73eaa178-06d6-45cf-bf15-28ff642a115e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.042383] env[61538]: INFO networking_nsxv3.common.synchronization [req-2ae6dcb0-7906-41c1-ba15-b6bebc5f416a req-d951a3dc-5cf3-4bab-95ad-7a69523e9755 service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1395.042671] env[61538]: INFO networking_nsxv3.common.synchronization [req-2ae6dcb0-7906-41c1-ba15-b6bebc5f416a req-d951a3dc-5cf3-4bab-95ad-7a69523e9755 service nova] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1395.042766] env[61538]: INFO networking_nsxv3.common.synchronization [req-2ae6dcb0-7906-41c1-ba15-b6bebc5f416a req-d951a3dc-5cf3-4bab-95ad-7a69523e9755 service nova] Enqueued Resource ID: 73eaa178-06d6-45cf-bf15-28ff642a115e with Priority: HIGHEST for action port [ 1395.043013] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_rules [ 1395.043149] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1395.043256] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73eaa178-06d6-45cf-bf15-28ff642a115e with Priority: HIGHEST for action port [ 1395.043813] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock rules-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.043949] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.044163] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.044386] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.044490] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.046216] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.046354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.046701] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock port-73eaa178-06d6-45cf-bf15-28ff642a115e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.046778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73eaa178-06d6-45cf-bf15-28ff642a115e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.046778] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73eaa178-06d6-45cf-bf15-28ff642a115e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.046942] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73eaa178-06d6-45cf-bf15-28ff642a115e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.047027] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73eaa178-06d6-45cf-bf15-28ff642a115e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.547109] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.547278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.548601] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73eaa178-06d6-45cf-bf15-28ff642a115e with status ACTIVE [ 1395.548789] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.548917] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.548993] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.549194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.549287] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.549458] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.549564] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.549620] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.549756] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.549835] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.550023] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.550136] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.550218] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.550365] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.550438] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.550526] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73eaa178-06d6-45cf-bf15-28ff642a115e is going to be updated. [ 1395.572396] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.572604] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.572661] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.572818] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.572970] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.573138] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73eaa178-06d6-45cf-bf15-28ff642a115e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.618525] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1395.618977] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e deletion is rescheduled due to dependency. [ 1395.620016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.620016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.620016] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.620016] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.620277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.620277] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.620354] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.620396] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.620468] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.122269] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.625270] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.128492] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.128952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.128952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.128952] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.129174] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.129174] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1397.159324] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.159485] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.159539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.159733] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.159882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.169519] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1399.181093] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1399.181470] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.181621] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.181914] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.182205] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.182405] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.182506] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.182732] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.182858] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.182989] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.183141] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.686137] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.686449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.686449] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.686589] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.686764] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.686868] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.686932] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.687097] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.687190] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.687278] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.687430] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.687528] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.687587] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.687727] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.687865] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.687958] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.688028] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.688167] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.688244] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.688327] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.688417] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.043880] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.044114] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1400.191872] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 685f27e5-d19d-4490-b97e-a0015776b51e: rpc.has_security_group_logging(os_id): False [ 1400.209308] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.209543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.209543] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.209784] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.209882] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.210170] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.210300] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.210378] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.210539] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.210619] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.210801] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.210897] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.210956] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.211122] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.211202] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.211385] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.211489] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.211532] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.211709] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.211789] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.211879] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1400.275217] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.275464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.275464] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.275629] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.275780] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.290120] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1402.312851] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1402.313267] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.044646] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.045099] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.056404] env[61538]: INFO networking_nsxv3.common.synchronization [req-b859187d-5e6b-4744-b923-6f86a09be149 req-faca8b74-0653-4a6d-a9d1-6e503a353455 tempest-ServerDiskConfigTestJSON-1666434622 tempest-ServerDiskConfigTestJSON-1666434622-project-member] Enqueued Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1406.057031] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 685f27e5-d19d-4490-b97e-a0015776b51e with Priority: HIGHEST for action security_group_members [ 1406.057264] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-685f27e5-d19d-4490-b97e-a0015776b51e taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.057374] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.057456] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.057670] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.057847] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.057951] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.058027] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.058193] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.058330] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.058406] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('685f27e5-d19d-4490-b97e-a0015776b51e',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.564980] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.564980] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.565194] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.565264] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.565402] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.565611] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.565711] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.565773] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.565964] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.566059] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.566145] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e is going to be updated. [ 1406.573145] env[61538]: INFO networking_nsxv3.common.synchronization [req-a53dade5-9459-4fc7-949b-b058dc419dcb req-06ca4209-6054-4c40-9fdf-9b4d87a6f0ac tempest-ServersTestManualDisk-1260630413 tempest-ServersTestManualDisk-1260630413-project-member] Enqueued Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_members [ 1406.573671] env[61538]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 with Priority: HIGHEST for action security_group_members [ 1406.573963] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock member-215b3675-f3e8-4643-8265-ee6bab0775d9 taken with stack trace [, , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.574089] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.574154] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.574337] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.574492] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.574585] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.574644] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.574782] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.574864] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.574954] env[61538]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('215b3675-f3e8-4643-8265-ee6bab0775d9',) {} {{(pid=61538) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.601894] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.601894] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.602121] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.602162] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.602301] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.612551] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: IN_PROGRESS for 2s [ 1407.076710] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.077058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.077058] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.077180] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.077284] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.077483] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.077584] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.077646] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.077793] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.077869] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.078040] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 is going to be updated. [ 1407.109536] env[61538]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=61538) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.109536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.109536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.109536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.109536] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.120689] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 in Status: IN_PROGRESS for 2s [ 1408.623448] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 685f27e5-d19d-4490-b97e-a0015776b51e in Status: SUCCESS [ 1408.623814] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 685f27e5-d19d-4490-b97e-a0015776b51e deletion is rescheduled due to dependency. [ 1408.623814] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-685f27e5-d19d-4490-b97e-a0015776b51e" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.130332] env[61538]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 in Status: SUCCESS [ 1409.130486] env[61538]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 215b3675-f3e8-4643-8265-ee6bab0775d9 deletion is rescheduled due to dependency. [ 1409.130626] env[61538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215b3675-f3e8-4643-8265-ee6bab0775d9" {{(pid=61538) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.574998] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.575394] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.576021] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.576421] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.577028] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.577419] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.577898] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.577898] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.579328] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.579820] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.580708] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.580708] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.582484] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.582484] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.583732] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.584157] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.585064] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.585475] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.586696] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.587204] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.587726] env[61538]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.588199] env[61538]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0